Abstract: A system and method of modifying error resiliency features by conveying temporal level 0 picture indices, such as tl0_pic_idx, within an SEI message instead of optionally including them in the NAL unit header is provided. In addition, a mechanism is provided for enabling repetition of any SEI messages in Real-Time Transport Protocol (RTP) packets. Enabling such repetition of any SEI messages facilitates detection of lost temporal level 0 pictures on the basis of any received packet.

Abstract: A video coder can select which reference pictures should be signaled in a parameter set such as a picture parameter set (PPS) and which reference pictures should be signaled in a slice header such that when a video decoder constructs a reference picture set, the video decoder does not need to reorder the reference picture set to construct an initial reference picture list for a slice of video data.

Abstract: Systems, devices, and methods for capturing and displaying picture data including picture orientation information are described. In one innovative aspect, a method for transmitting media information is provided. The method includes obtaining picture or video information, said picture or video information including image data and orientation information of a media capture unit when the picture or video information is obtained. The method further includes encoding said picture or video information, wherein the orientation information is included in a first portion and the image data is included in a second portion, the second portion being encoded and the first portion being distinct from the second portion. The method also includes transmitting the first portion and the second portion.

Abstract: Techniques are described for sending output indications in codec-hybrid multi-layer video coding, in which a base layer of video data is provided by an external system and conforms to a different video codec standard than one or more enhancement layers of the video data. An enhancement layer video decoder receives an enhancement layer bitstream that includes at least one enhancement layer to be decoded, an indication that the base layer is provided externally, and an indication of which layers are target output layers to be output for display. The external system does not receive a target output layer indication in a base layer bitstream. The disclosed techniques enable the enhancement layer video decoder, when the base layer is provided by the external system, to send an output indication to the external system indicating whether the base layer or specific base layer decoded pictures need to be output for display.

Abstract: In one example, a device includes one or more media decoders configured to decode media data, a network interface configured to receive a layered coding transport (LCT) Session Instance Description (LSID), the LSID including information representing a plurality of LCT sessions, each of the LCT sessions including data of a respective one of a plurality of representations of a DASH media presentation and data of one or more of the LCT sessions, and a processor configured to initiate consumption of one or more of the representations of the DASH media presentation using the LSID and without using a manifest file for the DASH media presentation, wherein to initiate consumption, the processor is configured to receive, via the network interface, packets of the LCT sessions including portions of data of the one or more of the representations; and provide data of the packets to the one or more media decoders.

Abstract: Systems, devices, and methods for capturing and displaying picture data including picture orientation information are described. In one innovative aspect, a method for transmitting media information is provided. The method includes obtaining picture or video information, said picture or video information including image data and orientation information of a media capture unit when the picture or video information is obtained. The method further includes encoding said picture or video information, wherein the orientation information is included in a first portion and the image data is included in a second portion, the second portion being encoded and the first portion being distinct from the second portion. The method also includes transmitting the first portion and the second portion.

Abstract: Techniques described herein are related to coding layer identifiers for operation points in video coding. In one example, a method of decoding video data is provided. The method comprises decoding syntax elements in a video parameter set (VPS) within a conforming bitstream indicating a first operation point having a first set of content. The method further comprises decoding, if present, syntax elements in the VPS within the conforming bitstream indicating hypothetical reference decoder (HRD) parameter information having a second set of content for the first operation point, wherein the conforming bitstream does not include syntax elements in the VPS that duplicate at least one of the first or second set of content for a second operation point, and wherein decoding syntax elements comprises decoding the syntax elements indicating the first operation point and the HRD parameter information only within conforming bitstreams.

Abstract: In general, techniques are described for coding picture order count values identifying long-term reference pictures. A video decoding device comprising a processor may perform the techniques. The processor may be configured to determine a number of bits used to represent least significant bits of the picture order count value that identifies a long-term reference picture to be used when decoding at least a portion of a current picture and parse the determined number of bits from a bitstream representative of the encoded video data. The parsed bits represent the least significant bits of the picture order count value. The processor retrieves the long-term reference picture from a decoded picture buffer based on the least significant bits, and decodes at least the portion of the current picture using the retrieved long-term reference picture.

Abstract: An apparatus for coding video information may include computing hardware configured to: when a current picture is to be predicted using at least inter layer motion prediction (ILMP): process a collocated reference index value associated with the current picture, wherein the collocated reference index value indicates a first reference picture that is used in predicting the current picture using inter layer prediction (ILP); and determine whether the first reference picture indicated by the collocated reference index value is enabled for ILMP; when the current picture is to be predicted using at least inter layer sample prediction (ILSP): process a reference index value associated with a block in the current picture, wherein the reference index value indicates a second reference picture that is used in predicting the block in the current picture using ILP; and determine whether the second reference picture indicated by the reference index value is enabled for ILSP.

Abstract: In some examples, a video encoder includes multiple sequence parameter set (SPS) IDs in an SEI message, such that multiple active SPSs can be indicated to a video decoder. In some examples, a video decoder activates a video parameter set (VPS) and/or one or more SPSs through referencing an SEI message, e.g., based on the inclusion of the VPS ID and one or more SPS IDs in the SEI message. The SEI message may be, as examples, an active parameter sets SEI message or a buffering period SEI message.

Abstract: Techniques are described related to coding of long-term reference pictures for a reference picture set. In some examples, a video coder may code candidate long-term reference pictures in a parameter set. The video coder also code syntax elements that indicate which long-term reference pictures from the candidate long-term reference pictures belong in the reference picture set.

Abstract: File formats and parsing and coding of video data are defined to promote more efficient random accessibility of coded video data. Constraints may be imposed on placement of parameter sets and the definition of sync samples in video files. Parameter set data for video data may be coded, for a non-sync sample, only in the sample entry for the sample, the sample, a previous sample in decoding order that is a sync sample, or in a sample occurring in decoding order between the sample and the previous sample in decoding order that is a sync sample.

Abstract: A device generates, in a container box of a file for storage of video contents, a SampleGroupDescription box that provides a sample group description for a sample grouping. The SampleGroupDescription box includes a grouping type syntax element having a particular value. Additionally, the SampleGroupDescription box includes one or more sample group entries. The device generates, in the same container box, a plurality of SampleToGroup boxes. Each respective SampleToGroup box of the plurality of SampleToGroup boxes includes a respective grouping type syntax element having the particular value, includes a respective sample count syntax element indicating a number of samples in a respective sample grouping, and includes a respective group description index syntax element indicating an index of an entry in the SampleGroupDescription box which describes samples of the respective sample grouping. Each sample of the respective sample grouping comprises a respective picture of the video contents.

Abstract: A first descriptor describes an operation point. The second descriptor is a hierarchy descriptor or a hierarchy extension descriptor. The second descriptor has a hierarchy layer index value equal to a value of the second syntax element. A first value of a first syntax element in the first descriptor specifies that an elementary stream indicated by a second syntax element in the first descriptor, when not present in an elementary stream list, shall be added into the list, and an elementary stream indicated by an index in the second descriptor, when not present in the list, shall be added to the list. Responsive to determining the first syntax element has a second value different from the first value, adding the elementary stream indicated by the second syntax element, when not present in the list, into the list, but not the elementary stream indicated by the index in the second descriptor.

Abstract: A video device for processing multi-layer video data includes a data storage medium configured to store the multi-layer video data and one or more processors configured to obtain the multi-layer video data; store the multi-layer video data in a file format; store representation format information for each operation point of the multi-layer video data in an operation points information (oinf) box for the file format; and generate a file of video data formatted according to the file format.

Abstract: A client device includes one or more processors configured to determine, from a manifest file, a plurality of types of segments included in a representation of media content, one or more functions provided by each of the types of segments, and positions of segments conforming to each of the types of segments in the representation, wherein at least one of the types of segments provides a point at which to begin retrieving data from the representation, determine, from the manifest file, a segment of the representation conforming to the type that provides the point at which to begin retrieving data from the representation, and retrieve the determined segment from the representation.

Abstract: Systems, devices, and methods for capturing and displaying picture data including picture orientation information are described. In one innovative aspect, a method for transmitting media information is provided. The method includes obtaining picture or video information, said picture or video information including image data and orientation information of a media capture unit when the picture or video information is obtained. The method further includes encoding said picture or video information, wherein the orientation information is included in a first portion and the image data is included in a second portion, the second portion being encoded and the first portion being distinct from the second portion. The method also includes transmitting the first portion and the second portion.

Abstract: A system and method for processing video data having a first random access point (RAP) picture. An access unit having a first random access point (RAP) picture is received in a video bitstream. A subsequent access unit having a RAP picture that does not initialize the hypothetical reference decoder (HRD) is also received and, based on one or more random access skipped leading (RASL) pictures for the subsequent access unit not being present in the video bitstream, a picture buffer removal time for a picture buffer is shifted earlier based on a picture buffer removal delay offset.

Abstract: An example method of decoding video data includes receiving, in a message associated with a picture, information indicating a refreshed region of the picture, determining whether the picture comprises a last picture in a gradual decoder refresh (GDR) set, determining whether the picture comprises a recovery point picture, and responsive to determining that the picture comprises the last picture in the GDR set and the recovery point picture, determining that the message indicates that the entire picture belongs to the refreshed region of the picture.

Abstract: A device decodes, from a scalable nesting supplemental enhancement information (SEI) message in an encoded video bitstream, a plurality of syntax elements that identify a plurality of operation points to which a nested SEI message encapsulated by the scalable nesting SEI message applies. Furthermore, the device uses one or more syntax elements of the nested SEI message to perform an operation regarding any of the operation points to which the nested SEI message applies.