Abstract: Block-based, low latency rate control for an encoding system in which a wavelet transform decomposes pixel blocks into subbands stored as subbands in wavelet blocks (WBs) for encoding. Quantization parameters (QPs) for the subbands in each WB are estimated using a method that minimizes wavelet-inverse distortion given a rate bound. For each subband, a rate curve is generated based on an unquantized DCT histogram and bit count statistics for the subband, and a distortion curve is generated based on the unquantized DCT histogram and a distortion estimate for the subband that is estimated using a masked estimator. Once the rate-distortion curves for the subbands are generated, a bisection search may be used to find a point on each curve where the slope is the same for all the curves. The QPs associated with those equally sloped points are the global minimizing QPs for the wavelet block.

Abstract: Systems and methods of parallel image parsing and processing for video decoding are provided. Video decoder circuitry may enable an incoming encoded bitstream to be split into multiple bitstreams corresponding to the bitstream compression scheme and processed by multiple parsers corresponding to the bitstream compression scheme in parallel. This enables parallel decoding of the incoming bitstream and, thus, more efficient decoder processing.

Abstract: Block-based, low latency rate control for an encoding system in which a wavelet transform decomposes pixel blocks into subbands stored as subbands in wavelet blocks (WBs) for encoding. Quantization parameters (QPs) for the subbands in each WB are estimated using a method that minimizes wavelet-inverse distortion given a rate bound. For each subband, a rate curve is generated based on an unquantized DCT histogram and bit count statistics for the subband, and a distortion curve is generated based on the unquantized DCT histogram and a distortion estimate for the subband that is estimated using a masked estimator. Once the rate-distortion curves for the subbands are generated, a bisection search may be used to find a point on each curve where the slope is the same for all the curves. The QPs associated with those equally sloped points are the global minimizing QPs for the wavelet block.

Abstract: Systems and methods of analyzing the luma statistics or chroma statistics to correct for image artifacts in decoded images. Video decoder circuitry may enable luma statistics collection circuitry housed in the loop filters to collect luma samples during the last stage of the decoding process. This enables output of luma statistics data and output of the decoded image together.

Abstract: Systems and methods of parallel image parsing and processing for video decoding are provided. Video decoder circuitry may enable an incoming encoded bitstream to be split into multiple bitstreams corresponding to the bitstream compression scheme and processed by multiple parsers corresponding to the bitstream compression scheme in parallel. This enables parallel decoding of the incoming bitstream and, thus, more efficient decoder processing.

Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands for a slice of a frame may be buffered so that complexity statistics may be calculated across the frequency bands prior to encoding. The statistics may then be used by a rate control component in determining quantization parameters for the frequency bands for modulating the rate in the encoder for the current slice. The quantization parameters for the frequency bands may be calculated jointly to optimize the quality of the displayed frames after decoder reconstruction and wavelet synthesis on a receiving device. Information about one or more previously processed frames may be used in combination with the statistics for a current slice in determining the quantization parameters for the current slice.

Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands for a slice of a frame may be buffered so that complexity statistics may be calculated across the frequency bands prior to encoding. The statistics may then be used by a rate control component in determining quantization parameters for the frequency bands for modulating the rate in the encoder for the current slice. The quantization parameters for the frequency bands may be calculated jointly to optimize the quality of the displayed frames after decoder reconstruction and wavelet synthesis on a receiving device. Information about one or more previously processed frames may be used in combination with the statistics for a current slice in determining the quantization parameters for the current slice.

Abstract: Block-based, low latency rate control for an encoding system in which a wavelet transform decomposes pixel blocks into subbands stored as subbands in wavelet blocks (WBs) for encoding. Quantization parameters (QPs) for the subbands in each WB are estimated using a method that minimizes wavelet-inverse distortion given a rate bound. For each subband, a rate curve is generated based on an unquantized DCT histogram and bit count statistics for the subband, and a distortion curve is generated based on the unquantized DCT histogram and a distortion estimate for the subband that is estimated using a masked estimator. Once the rate-distortion curves for the subbands are generated, a bisection search may be used to find a point on each curve where the slope is the same for all the curves. The QPs associated with those equally sloped points are the global minimizing QPs for the wavelet block.

Abstract: Block-based, low latency rate control for an encoding system in which a wavelet transform decomposes pixel blocks into subbands stored as subbands in wavelet blocks (WBs) for encoding. Quantization parameters (QPs) for the subbands in each WB are estimated using a method that minimizes wavelet-inverse distortion given a rate bound. For each subband, a rate curve is generated based on an unquantized DCT histogram and bit count statistics for the subband, and a distortion curve is generated based on the unquantized DCT histogram and a distortion estimate for the subband that is estimated using a masked estimator. Once the rate-distortion curves for the subbands are generated, a bisection search may be used to find a point on each curve where the slope is the same for all the curves. The QPs associated with those equally sloped points are the global minimizing QPs for the wavelet block.

Abstract: A video encoding system in which pixel data is decomposed into frequency bands prior to encoding. The frequency bands for a slice of a frame may be buffered so that complexity statistics may be calculated across the frequency bands prior to encoding. The statistics may then be used by a rate control component in determining quantization parameters for the frequency bands for modulating the rate in the encoder for the current slice. The quantization parameters for the frequency bands may be calculated jointly to optimize the quality of the displayed frames after decoder reconstruction and wavelet synthesis on a receiving device. Information about one or more previously processed frames may be used in combination with the statistics for a current slice in determining the quantization parameters for the current slice.

Abstract: A method includes calculating a complexity value for each segment or version of multimedia content. The multimedia content has multiple versions associated with common content and different encoding parameters, and each version is divided into segments. The method also includes adaptively streaming the multimedia content to a client device based on at least some of the calculated complexity values. The complexity value for each segment or version is calculated by summing multiple operation complexity values defining complexities of operations for decoding the segment or version. The operation complexity values could include values for a bit parsing operation, a buffer initialization operation, an intra-prediction operation, an inverse quantization and transform operation, a reference block fetch operation, a fractional interpolation operation, and in-loop deblocking operation, a sample adaptive offset correction operation, an adaptive loop filtering operation, and a de-ringing filtering operation.

Abstract: A video decoder performs a method of dynamic voltage/frequency scaling (DVFS) for video processing. The method includes parsing a bitstream associated with a video to determine embedded information associated with a complexity of a first portion of the video, estimating the complexity of the first portion of the video using the embedded information, determining a voltage and frequency to be used for decoding the first portion of the video based on the estimated complexity, and decoding the first portion of the video at the determined voltage and frequency.

Abstract: A method for providing display adaptation metadata (DAM) to a user equipment (UE) at a system level is provided. The method includes configuring DAM for storage in an ISO Base Media File Format (ISOBMFF). The method also includes transmitting the DAM to a UE to control an energy consumption of a presentation on a display of the UE. A method for providing display adaptation metadata (DAM) to a user equipment (UE) at a system level is provided. The method includes configuring DAM for carriage in an MPEG-2 transport system (M2TS). The method also includes transmitting the DAM to a UE to control an energy consumption of a presentation on a display of the UE.

Abstract: Apparatus and methods scale a backlight of a display. A graphics processing unit (GPU) is configured to calculate a histogram. A central processing unit (CPU) is configured to control the backlight of the display responsive to a backlight level that is based on the histogram.

Abstract: A method for providing display adaptation metadata (DAM) to a user equipment (UE) at a system level is provided. The method includes configuring DAM for storage in an ISO Base Media File Format (ISOBMFF). The method also includes transmitting the DAM to a UE to control an energy consumption of a presentation on a display of the UE. A method for providing display adaptation metadata (DAM) to a user equipment (UE) at a system level is provided. The method includes configuring DAM for carriage in an MPEG-2 transport system (M2TS). The method also includes transmitting the DAM to a UE to control an energy consumption of a presentation on a display of the UE.

Abstract: An apparatus and method for video fingerprinting are provided. The method includes, for each frame of a video sequence including a plurality of frames, removing a portion of the frame, dividing a remaining portion of the frame into blocks, dividing each block into sub-blocks, computing a block level feature as a mean of pixels in each sub-block within the block, concatenating all block level features in the frame, and concatenating features of all frames in the video sequence.

Abstract: A video decoder performs a method of dynamic voltage/frequency scaling (DVFS) for video processing. The method includes parsing a bitstream associated with a video to determine embedded information associated with a complexity of a first portion of the video, estimating the complexity of the first portion of the video using the embedded information, determining a voltage and frequency to be used for decoding the first portion of the video based on the estimated complexity, and decoding the first portion of the video at the determined voltage and frequency.

Abstract: Segments for a video are transmitted in payload units with a supplemental enhancement information (SEI) message within which is embedded display adaptation information that may be employed to control display brightness and thereby reduce power consumption during display of the respective segment. The display adaptation information includes at least a maximum pixel brightness that may be used to scale pixel brightness to maximum and correspondingly reduce backlighting for liquid crystal displays, or to adjust the supply voltage for OLED displays. The display adaptation information may optionally include a minimum pixel brightness, a pixel histogram step size, and an indicator of scaling method.

Abstract: A method includes receiving a video bitstream and a flag and interpreting the flag to determine a transform that was used at an encoder. The method also includes, upon a determination that the transform that was used at the encoder includes a secondary transform, applying an inverse secondary transform to the received video bitstream, where the inverse secondary transform corresponds to the secondary transform used at the encoder. The method further includes applying an inverse discrete cosine transform (DCT) to the video bitstream after applying the inverse secondary transform.

Abstract: An image-encoding system that is configured to generate an output stream based on an input image is provided that includes an encoder and a metadata extractor. The encoder is configured to encode a low-resolution image to generate a quantized, low-resolution image. The low-resolution image is generated based on the input image. The metadata extractor is configured to extract super-resolution (SR) metadata from the input image. The output stream comprises the quantized, low-resolution image and the SR metadata. An image-decoding system is configured to receive the output stream. The image-decoding system includes a decoder and an SR processor. The decoder is configured to decode the quantized, low-resolution image to generate a decoded image. The super-resolution processor is configured to perform super-resolution on the decoded image based on the SR metadata to generate a super-resolved image.