Abstract: A method, apparatus and computer program products are provided for capturing omnidirectional video with one or more cameras, streaming the video over a network, and rendering the video on a Head Mounted Display (HMD) and more specifically to a method, apparatus, and computer program product for improving the visual quality of viewport-based omnidirectional video streaming. One example method includes selecting a primary viewport, encoding a first representation that covers the primary viewport, and encoding a second representation that provides a gradual picture quality change from a background viewport to the primary viewport.

Abstract: A method, apparatus and computer program products are provided for capturing omnidirectional video with one or more cameras, streaming the video over a network, and rendering the video on a Head Mounted Display (HMD) and more specifically to a method, apparatus, and computer program product for improving the visual quality of viewport-based omnidirectional video streaming. One example method includes selecting a primary viewport, encoding a first representation that covers the primary viewport, and encoding a second representation that provides a gradual picture quality change from a background viewport to the primary viewport.

Abstract: A method comprising: identifying at least one boundary in an image based on one or more signal characteristics; classifying a region of the image containing the boundary as a region containing an edge; determining context-based information about the region to be signaled in a bitstream of video data; partitioning the region at least in two along the edge; and applying a transform on the region.

Abstract: A method comprising: obtaining a video bitstream comprising a high dynamic range (HDR) video representation; obtaining one or more tone mapping operators and an indication of at least one tone mapping operator to be applied; and modifying the HDR video representation into a low dynamic range (LDR) video representation using said at least one tone mapping operator determined by said indication.

Abstract: A method comprising: obtaining a video bitstream comprising a low dynamic range (LDR) video representation; obtaining one or more tone mapping operators and an indication of at least one tone mapping operator to be applied; decoding enhancement data relating to said LDR video representation; modifying the LDR video representation into a first high dynamic range (HDR) video representation using said at least one tone mapping operator determined by said indication; and combining the first HDR video representation and the enhancement data relating to said LDR video representation to provide a second HDR video representation.

Abstract: A video coding method comprises dividing a coefficient vector into two or more sub-vectors, each sub-vector having a length less than or equal to a length of the coefficient vector, indicating a size of each sub-vector and a position of each sub-vector within the coefficient vector, and forming a block corresponding to each sub-vector.

Abstract: An improved system and method for providing improved inter-layer prediction for extended spatial scalability in video coding, as well as improving inter-layer prediction for motion vectors in the case of extended spatial scalability. In various embodiments, for the prediction of macroblock mode, the actual reference frame index and motion vectors from the base layer are used in determining if two blocks should be merged. Additionally, multiple representative pixels in a 4×4 block can be used to represent each 4×4 block in a virtual base layer macroblock. The partition and motion vector information for the relevant block in the virtual base layer macroblock can be derived from all of the partition information and motion vectors of those 4×4 blocks.

Abstract: A system and method for predicting an enhancement layer macroblock. A base layer frame is divided into intra-coded and inter-coded regions. If any portion of the enhancement layer macroblock is covered by both an intra-coded base layer macroblock and an inter-coded base layer macroblock, predictions utilizing the intra-coded and inter-coded macroblocks are established independently to generate at least two prediction values. The at least two prediction values are then combined to give a prediction from which the enhancement layer block is coded. Various embodiments serve to smooth the boundary effect between intra-coded regions and inter-coded regions inside the inter-layer prediction for extended spatial scalability.

Abstract: A system and method for providing improved FGS identification in scalable video coding. According to the present invention, each FGS enhancement layer is assigned a unique dependency identifier and contains only FGS enhancement information. For subsequent enhancement layers, the base dependency identifier for the subsequent enhancement layers will point to either a base-quality layer or an FGS enhancement layer.

Abstract: A method, program product and apparatus for decoding from a scalable bit stream the binarization results of a video sequence by selectively decoding syntax elements and avoiding redundancy in coding. The result is a decrease in the size of the compressed bit stream of an enhancement layer bit stream. It has been demonstrated that the compression efficiency equals that of a single, non-scalable video stream for some video sequences. These features may be achieved by determining whether a skipping flag in the base layer macro block of the video data is set, and decoding a skipping flag from an enhancement layer macro block of the video data, corresponding to the base layer macro block, only if the base layer macro block skipping flag is set.

Abstract: A method for coding spatial and quality enhancement information in scalable video coding using variable length codes. Conventional systems have been capable of using variable length codes only with nonscalable video coding, In the present invention, the coded block pattern for each block of information, significance passes, and refinement passes can all be coded with different types of variable length codes. The present invention also provides for a variable length encoder/decoder that dynamically adapts to the actual symbol probability. The encoder/decoder of the present invention counts the number of times each symbol is coded. Based upon these counts, the encoder/decoder selects how many symbols to group when forming a code word. The encoder also uses these counts to select the specific codeword that should be used.

Abstract: A video coding method comprises dividing a coefficient vector into two or more sub-vectors, each sub-vector having a length less than or equal to a length of the coefficient vector, indicating a size of each sub-vector and a position of each sub-vector within the coefficient vector, and forming a block corresponding to each sub-vector

Abstract: A system and method for providing improved residual prediction for spatial scalability in video coding. In order to prevent visual artifacts in residual prediction in extended spatial scalability (ESS), each enhancement layer macroblock is checked to determine if the macroblock satisfies a number of conditions. If the conditions are met for an enhancement layer macroblock, then it is likely that visual artifacts will be introduced if applying residual prediction on the macroblock. Once such locations are identified, various mechanisms may be used to avoid or remove the visual artifacts.

Abstract: An improved system and method for providing improved inter-layer prediction for extended spatial scalability in video coding, as well as improving inter-layer prediction for motion vectors in the case of extended spatial scalability. In various embodiments, for the prediction of macroblock mode, the actual reference frame index and motion vectors from the base layer are used in determining if two blocks should be merged. Additionally, multiple representative pixels in a 4×4 block can be used to represent each 4×4 block in a virtual base layer macroblock. The partition and motion vector information for the relevant block in the virtual base layer macroblock can be derived from all of the partition information and motion vectors of those 4×4 blocks.

Abstract: An improved system and method for enabling the insertion, overlay, removal or replacement of sequential or concurrent targeted program segments and/or visual icons in a video bitstream without modifying the fidelity of the underlying visual media. The present invention provides for a wide variety of supplemental enhancement information fields which permit the use of data updates that are synchronous with delivered video content. The present invention offers a generic approach to program insertion and iconic overlay that covers a wide range of use-cases and applications, without necessarily transmitting the visual content to be inserted as part of the underlying visual media stream.

Abstract: A system and method for predicting an enhancement layer macroblock. A base layer frame is divided into intra-coded and inter-coded regions. If any portion of the enhancement layer macroblock is covered by both an intra-coded base layer macroblock and an inter-coded base layer macroblock, predictions utilizing the intra-coded and inter-coded macroblocks are established independently to generate at least two prediction values. The at least two prediction values are then combined to give a prediction from which the enhancement layer block is coded. Various embodiments serve to smooth the boundary effect between intra-coded regions and inter-coded regions inside the inter-layer prediction for extended spatial scalability.

Abstract: A system and method for improved video encoding and decoding. The present invention addresses issues that arise in the H.264/AVC standard involving “high magnitude coefficients.” According to various embodiments of the present invention, an encoded end of block (EOB) symbol provides information comprising at least one of the maximum magnitude of values in a block, the number of values in the block with a magnitude greater than 1, and a variable length code (VLC) index indicating a VLC to be used in decoding precise magnitudes for non-zero values in the block. By including this information in the EOB symbol, improved coding efficiency is achieved.

Abstract: Methods, computer code products and devices for encoding and/or decoding video data in multiple passes, the video data having a multiple components each component including multiple coefficients. The method can starting the next pass of the encoding or decoding process immediately after the end of the current encoding or decoding pass for a given component without regard to whether other components have finished the current encoding or decoding pass. In addition, stagger delays and dampers can be used to more closely regulate the encoding or decoding process to ensure that one component is not encoded or decoded too quickly with respect to other components.

Abstract: An improved system and method for effectively reducing prediction drift and improving coding efficiency in scalable video coding. The present invention provides an improved method for determining an offset value that is used to adjust the value of ?, a leaky factor for a block of data that includes only zero coefficients at a base layer. In one embodiment of the invention, the offset value is determined based upon information in the enhancement layer at issue instead of the base layer. In another embodiment, information in both the enhancement layer and the base layer of the current frame is used in determining the offset value.

Abstract: The present invention involves the use of the FRExt approach for FGS. According to the present invention, an 8×8 data block is de-interleaved and processed as individual 4×4 data blocks, with an additional end-of-8×8-block (EO8B) marker indicating that no more coefficients remain in any of the de-interleaved 4×4 data blocks. The EO8B symbol may be a binary flag. The invention also uses a longer codeword for the EO8B symbol, conveying information about which de-interleaved blocks contain additional coefficients.