Abstract: Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that partitions a current picture into a plurality of sub-pictures. Each of the plurality of sub-pictures corresponds to a different region of the current picture. The processing circuitry encodes each of the plurality of sub-pictures based on one or more layers associated with the respective one of the plurality of sub-pictures. The plurality of sub-pictures includes (i) a first sub-picture that is associated with a first number of layers, and (ii) a second sub-picture that is associated with a second number of layers that is different from the first number of layers.

Abstract: A method includes segmenting a multidimensional media stream into a plurality of segments of multidimensional media in a multidimensional space; representing each segment of the plurality of segments of multidimensional media using a respective sequence vector, the respective sequence vector comprising one or more predefined multidimensional metadata, wherein the predefined multidimensional metadata includes a startcode that is an identical unique code point and a sequence number, wherein each segment includes the identical unique code point; and deriving a network based media processing (NBMP) workflow based on the respective sequence vector of each segment of the plurality of segments.

Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining video data, creating, based on the video data, a timed metadata track indicating a segment bandwidth and comprising information of a plurality of aligned segments of a media adaptation set such that duration information and size information of each of the aligned segments is included in at least one metadata sample, switching to one of a plurality of representations of the video data based whether the timed metadata track indicates at least an overflow to an input buffer per each of the plurality of representations, and delivering the one of the plurality of representations to a client.

Abstract: A method and apparatus may be provided for signaling auxiliary media including pre-roll media content and mid-roll media content in a main media stream including receiving main media presentation descriptions (MPD) comprising one or more main media segments and at least one auxiliary descriptor referencing one or more auxiliary MPDs. The auxiliary MPD may include one or more auxiliary media segments that are independent of the one or more main media segments. The method may include retrieving the one or more auxiliary MPDs referenced in the one or more main MPD using the at least one auxiliary descriptor, the auxiliary MPD of the one or more auxiliary MPDs comprising the one or more auxiliary media segments and an auxiliary media presentation duration. The one or more auxiliary media segments and the one or more main media segments may be appended to a media source extension (MSE) source buffer and dispatched.

Abstract: A method of managing capabilities of a media streaming network using at least one processor, including receiving a capability request for media streaming capabilities of an edge data network (EDN); determining the media streaming capabilities of the EDN; transmitting a capability response based on the determined media streaming capabilities; receiving a media processing workflow request based on the capability response; establishing a media streaming session according to the media processing workflow request; and streaming media content based on the media streaming session.

Abstract: Method, apparatus, and system for haptic signal processing are provided. The process may include receiving a haptic track comprising more than one type of moving picture experts group (MPEG) immersive haptics stream (MIHS) unit. The process may include obtaining, from the haptic track, a first type of MIHS unit that comprises haptic information and obtaining, from the haptic track, a second type of MIHS unit, the second type of MIHS unit being an empty unit comprising only duration information. The process may include determining a quiet period of the haptic track based on the duration information in the second type of MIHS unit.

Abstract: Method, apparatus, and system for haptic signal processing are provided. The process may include receiving a media stream comprising at least one haptic track and at least one media track. The process may include obtaining at least one MIHS unit from the media stream and obtain a respective start time associated with the at least one MIHS unit from the media stream. The process may include the media stream being rendered based on the respective start time. Each of the at least one MIHS unit is non-overlapping in time, a MIHS unit among the at least one MIHS unit comprises a start time for the MIHS unit, and the MIHS unit is associated with one or more haptic channel.

Abstract: Method, apparatus, and system for haptic signal processing are provided. The process may include receiving a media stream comprising at least one haptic track and at least one video track. The process may include obtaining, from the media stream, one or more moving picture experts group (MPEG) immersive haptics stream (MIHS) units and obtaining, from the media stream, timing information associated with one or more haptic effects, the timing information comprises at least one temporal position of the one or more haptic effects. Then the process may include rendering the media stream based on the obtained timing information.

Abstract: Method, apparatus, and system for encoding or decoding media are provided. The process may include obtaining a track group entry box from an ISO base media file format (ISOBMFF) track associated with a video data. It may also include obtaining a first track among the one or more tracks in the CMAF switching set associated with the video data that has a first alternative group parameter and obtaining a second track associated with the video data that has a second alternative group parameter. The second alternative group parameter and the first alternative group parameter may have a same value. The process may also include decoding the video data based on the first track or the second track in the CMAF switching set.

Abstract: Method, apparatus, and system for haptic signal processing are provided. The process may include receiving a bitstream comprising one or more haptic channels one or more moving picture experts group (MPEG) immersive haptics stream (MIHS) units may be obtained for the one or more haptic channels, with a MIHS unit including timing information for one or more haptic effects. The process may also include timing information being obtained for the one or more haptic effects from the one or more MIHS units, the timing information for the one or more haptic effects including an offset associated with the one or more haptic effects. The one or more haptic effects may be rendered based on the obtained timing information.

Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining media data, generating, from the media data, one or more event segments, appending the one or more event segments, to a first event processing buffer, the one or more event segments comprising an event start offset for each of the one or more event segments based on a time at which the each of the one or more event segments is appended to the first event processing buffer, appending the one or more event segments, to a second event processing buffer, the one or more event segments comprising event dispatch information for the each of the one or more event segments, and dispatching the one or more event segments based on the first event processing buffer and the event dispatch information in the second event processing buffer.

Abstract: A method and apparatus for providing video content in a Dynamic Adaptive Streaming over Hypertext Transfer Protocol (DASH) streaming session may be provided. The method may include obtaining a pre-session-based description (PreSBD) information of the DASH streaming session instructing a PreSBD client to generate customized session-based description (SBD) document uniform resource locator (URL) for a plurality of SBD descriptors of the DASH streaming session. The method may further include instantiating the PreSBD client and passing PreSBD descriptor information. Then, the method may include controlling generation of a customized SBD document URL associated with a first SBD descriptor from the plurality of SBD descriptors of the DASH streaming session. The method may further include launching a first SBD client based on the customized SBD document URL and passing the first SBD descriptor.

Abstract: A method is provided. The method includes generating, by a 5th generation media streaming (5GMS) application provider, an edge configuration resource including at least one edge enabler client (EEC) capability specification, transmitting, by the 5GMS application provider, a request for provisioning an edge application server (EAS) to operate as a 5GMS application server (AS), the request including the edge configuration resource, and selecting, by the 5GMS application provider, the EAS to operate as the 5GMS AS based on the EAS being capable of performing the at least one EEC capability specification included in the edge configuration resource.

Abstract: Aspects of the disclosure provide methods and apparatuses for video conference and/or telepresence. In some examples, video conference/telepresence can be performed by multiple client devices, user devices and a media control device (e.g., server device). For example, a first client device determines a grouping control that limits a grouping of an overlay media from a second client device with an immersive media of the first client device, and transmits a grouping control signal indicative of the grouping control to inform a media control device. Further, the first client device provides one or more media including the immersive media to the media control device. The media control device can group a plurality of immersive media streams in a single or multiple groups based on the grouping control signal received from the first client device.

Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining media content from a first content server, determining whether a manifest indicates presence of a remote element, resolving the remote element, manipulating an updated remote element, and streaming at least one of the media content from the first content server and another media content from a second content server based on manipulating the updated remote element.

Abstract: Aspects of the disclosure provide methods, apparatuses, and a non-transitory computer-readable storage medium for receiving media data. One apparatus includes processing circuitry that receives a media presentation description (MPD) file. The MPD file includes key-value pair information for a session-based description (SBD) file. The SBD file includes a plurality of session-based parameters. The processing circuitry determines which of the plurality of session-based parameters in the SBD file is to be included in a query based on the key-value pair information in the MPD file. The processing circuitry further generates the query based on the determination of which of the plurality of session-based parameters in the SBD file is to be included in the query.

Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for processing media streams. An apparatus includes processing circuitry that sends a message to a media aware network element that is configured to process a plurality of audio streams of a conference call. The message indicates that the plurality of audio streams is to be down mixed by the media aware network element. The processing circuitry receives the down mixed plurality of audio streams from the media aware network element and decodes the down mixed plurality of audio streams to receive the conference call.

Abstract: A method executed by at least one processor, the method comprising: segmenting a multidimensional media stream into a plurality of segments of multidimensional media in a multidimensional space; representing each segment of the plurality of segments of multidimensional media using a respective sequence vector, the respective sequence vector comprising one or more predefined multidimensional metadata, wherein the predefined multidimensional metadata includes one of a starting vector, a length vector, and a scaling vector, and a startcode; and deriving a network based media processing (NBMP) workflow based on the respective sequence vectors of each segment of the plurality of segments.

Abstract: A method and a device for signaling multiple audio mixing gains in a teleconference using Real-time Transport Control Protocol (RTCP) feedback. The method includes receiving an input audio stream from a 360-degree video stream, the input audio stream including mixing gains, declaring an RTCP feedback rate for receiving the mixing gains, based on an allocated bandwidth, and signaling the mixing gains using the declared RTCP feedback rate. The mixing gains may include audio gains from the input audio stream and audio gains from overlay audio streams. The RTCP feedback rate used for signaling the mixing gains may be constant or event-based feedback rate.

Abstract: This disclosure generally relates to media application development and deployment using an NBMP system. More specifically, this disclosure describes methods and apparatuses for instance level configuration of functions used in NBMP workflows. Example mechanisms are provided for configuring different instances of a same function in various tasks in a media processing workflow with customized configurations and restrictions based on a format of a general configuration descriptor of the function.