Abstract: This disclosure describes systems, methods, and devices related to complexity aware encoding. A device may generate a list of encodes based on pairs of resolution and quantization parameters (QP) pairs associated with one or more video segments received from a source. The device may generate an estimated bit rate associated with the one or more video segments based on an analysis of the one or more video segments. The device may determine distortion values associated with the one or more video segments. The device may apply a weighting mechanism to the distortion values using the estimated bit rate. The device may select a subset of encodes based on the weighting mechanism. The device may perform the subset of encodes on the one or more video segments for transmission.

Abstract: This disclosure describes systems, methods, and devices related to bit-rate-based variable accuracy level encoding. A device may generate a list of encodes based on pairs of resolutions and quantization parameters (QP) associated with one or more video segments received from a source. The device may generate an estimated bit rate associated with the one or more video segments based on an analysis of the one or more video segments. The device may utilize an accuracy level of encoding for an encoder based on the estimated bit rate. The device may encode the one or more video segments based on the accuracy level of encoding.

Abstract: This disclosure describes systems, methods, and devices related to bit-rate-based hybrid encoding. A device may generate a list of encodes based on pairs of resolution and quantization parameters (QP) pairs associated with one or more video segments received from a source. The device may generate an estimated bit rate associated with the one or more video segments based on an analysis of the one or more video segments. The device may compare the estimated bit rate to a threshold. The device may switch between a software encoder and a hardware encoder based on the comparison of the estimated bit rate to the threshold. The device may encode each of the one or more video segments for transmission using the hardware encoder or the software encoder.

Abstract: Techniques related to transform coefficient shaping for video encoding are discussed. Such techniques include applying weighting parameters from one or more perceptually-designed matrices of weighting parameters to blocks of transform coefficients to generate weighted transform coefficients and encoding the weighted transform coefficients into a bitstream. The process may be based on sets of perceptually designed matrices of weighting parameters. Classifier outputs may be used to select from the set of perceptually designed matrices a subset of matrices to work with. The latter may be used in a synthesis procedure to develop the final weighting matrix to be used is shaping the transform coefficients.

Abstract: Techniques related to distributing the video encoding processing of an input video across hardware and software systems. Such techniques include evaluating the content of the video and determine whether or the encoding operation is best to be done on the hardware system only, software system only or a hybrid hardware and software system.

Abstract: Techniques related to video encoding are discussed that, for each block of input video, select an individual partitioning and coding mode selection technique from multiple such selection techniques. For a picture, the selection algorithm takes as input scores for individual blocks, costs of the various partitioning and coding mode selection techniques, and various detector outputs. The selection algorithm provides as output a partitioning and coding mode selection technique for each block in picture. The algorithms selection is such that the overall cost of the selected algorithms in the picture is as close as possible to a given picture budget. Furthermore, a partitioning and coding mode selection algorithms, binary depth partitioning (BDP), is discussed. For a block, BDP provides fast convergence to a partitioning and associated coding modes first evaluating intermediate partitioning options and converging on the final partitioning by evaluating either larger of smaller partitions.

Abstract: Techniques related to video encoding that provide for a decoupled prediction and coding structure for improved performance are discussed. Such techniques include determining final partitioning decisions for blocks of a picture by evaluating intra modes for candidate partitions by comparing the candidate partitions to intra predicted partitions generated using only original pixel samples and evaluating inter modes for the candidate partitions by comparing the candidate partitions to search partitions including original pixel samples and encoding using the final partitioning decision.

Abstract: Techniques related to video encoding that provide for a decoupled prediction and coding structure for improved performance are discussed. Such techniques include determining final partitioning decisions for blocks of a picture by evaluating intra modes for candidate partitions by comparing the candidate partitions to intra predicted partitions generated using only original pixel samples and evaluating inter modes for the candidate partitions by comparing the candidate partitions to search partitions including original pixel samples and encoding using the final partitioning decision.

Abstract: Techniques related to transform coefficient shaping for video encoding are discussed. Such techniques include applying weighting parameters from one or more perceptually-designed matrices of weighting parameters to blocks of transform coefficients to generate weighted transform coefficients and encoding the weighted transform coefficients into a bitstream. The process may be based on sets of perceptually designed matrices of weighting parameters. Classifier outputs may be used to select from the set of perceptually designed matrices a subset of matrices to work with. The latter may be used in a synthesis procedure to develop the final weighting matrix to be used is shaping the transform coefficients.

Abstract: Techniques related to detection of features and modification of encoding based on such detected features for improved data utilization efficiency are discussed. Such techniques include generating a partitioning decision for a block and coding mode decisions for partitions of the individual block using the detected features or indicators thereof based on one or more of generating a luma and chroma or luma only evaluation decision for a partition, generating a merge or skip mode decision for a partition having an initial merge mode decision, generating only a portion of a transform coefficient block for a partition, and evaluating 4×4 partitions only for any partition of the partitions that are 8×8 initial coding partitions.

Abstract: Techniques related to video encoding are discussed that, for each block of input video, select an individual partitioning and coding mode selection technique from multiple such selection techniques. For a picture, the selection algorithm takes as input scores for individual blocks, costs of the various partitioning and coding mode selection techniques, and various detector outputs. The selection algorithm provides as output a partitioning and coding mode selection technique for each block in picture. The algorithms selection is such that the overall cost of the selected algorithms in the picture is as close as possible to a given picture budget. Furthermore, a partitioning and coding mode selection algorithms, binary depth partitioning (BDP), is discussed. For a block, BDP provides fast convergence to a partitioning and associated coding modes first evaluating intermediate partitioning options and converging on the final partitioning by evaluating either larger of smaller partitions.

Abstract: A method of motion vector prediction for use in differential motion vector coding within a block motion-compensation-based video coder. The video coder employs a generalized multiple reference picture buffer which may contain multiple reference pictures in both the forward and backward temporal direction from the current picture. For the purpose of coding selections of reference pictures within the buffer, the pictures are organized into two, potentially overlapping, lists of reference pictures. The prediction of a motion vector that selects a reference picture using a given reference picture list is not dependent upon any motion vectors that select their reference pictures using the other reference picture list. The values of spatially neighboring motion vectors that use the same list of reference pictures as the motion vector being predicted are used for prediction, regardless of the relative temporal direction of the current and neighboring motion vectors.

Abstract: A method of motion vector prediction for use in differential motion vector coding within a block motion-compensation-based video coder. The video coder employs a generalized multiple reference picture buffer which may contain multiple reference pictures in both the forward and backward temporal direction from the current picture. For the purpose of coding selections of reference pictures within the buffer, the pictures are organized into two, potentially overlapping, lists of reference pictures. The prediction of a motion vector that selects a reference picture using a given reference picture list is not dependent upon any motion vectors that select their reference pictures using the other reference picture list. The values of spatially neighbouring motion vectors that use the same list of reference pictures as the motion vector being predicted are used for prediction, regardless of the relative temporal direction of the current and neighbouring motion vectors.

Abstract: A method of motion vector prediction for use in differential motion vector coding within a block motion-compensation-based video coder. The video coder employs a generalized multiple reference picture buffer which may contain multiple reference pictures in both the forward and backward temporal direction from the current picture. For the purpose of coding selections of reference pictures within the buffer, the pictures are organized into two, potentially overlapping, lists of reference pictures. The prediction of a motion vector that selects a reference picture using a given reference picture list is not dependent upon any motion vectors that select their reference pictures using the other reference picture list. The values of spatially neighboring motion vectors that use the same list of reference pictures as the motion vector being predicted are used for prediction, regardless of the relative temporal direction of the current and neighboring motion vectors.

Abstract: Disclosed are adaptive loop filtering techniques for video encoding and/or decoding. For a video unit, the encoder selects a set of predefined filters or generates a set of new filters, and places into the bitstream information identifying the set of predefined filters, or information defining the set of new filters. The set of filters may be used for loop filtering of at least one of the reconstructed samples of the video unit. At the decoder, a set of filters may be obtained by, decoding an index that identifies a set of predefined filters, or by decoding information related to a set of new filters. The obtained set of filters may be used for loop filtering of at least one decoded and reconstructed sample of the video unit.

Abstract: Disclosed are adaptive loop filtering techniques in the context of video encoding and/or decoding. For each video unit, the encoder can select a filter shape, and can place into the bitstream information that identifies the filter shape. At least one filter whose shape is the selected filter shape is used to loop filter at least one sample. At the decoder, a filter shape is obtained by decoding information that identifies the filter shape. At least one filter whose shape is the obtained filter shape is used to loop filter at least one reconstructed sample. Different filter shapes are also disclosed.

Abstract: Disclosed are techniques for adaptive interpolation filtering of luminance and chrominance samples in the context of motion compensation in video encoding or decoding. A two-dimensional interpolation filter of n×m coefficients may be separable, i.e., it may be separated into two one-dimensional filters with m and n coefficients, respectively. The bitstream may include, per video unit and sub-sample position, information indicating whether to use a newly-generated, a cached, or a default filter that may be a separable two-dimensional filter. The information may be structured in a way that takes advantage of the two-dimensional filter being separable. When a newly-generated filter is signalled, the bitstream may contain information pertaining to the characteristics of the newly-generated filter, such as its coefficients. A decoder may fetch this information from the bitstream to create the filters which are applied to samples of the video unit. An encoder may create a bitstream as described.

Abstract: A method of motion vector prediction for use in differential motion vector coding within a block motion-compensation-based video coder. The video coder employs a generalized multiple reference picture buffer which may contain multiple reference pictures in both the forward and backward temporal direction from the current picture. For the purpose of coding selections of reference pictures within the buffer, the pictures are organized into two, potentially overlapping, lists of reference pictures. The prediction of a motion vector that selects a reference picture using a given reference picture list is not dependent upon any motion vectors that select their reference pictures using the other reference picture list. The values of spatially neighbouring motion vectors that use the same list of reference pictures as the motion vector being predicted are used for prediction, regardless of the relative temporal direction of the current and neighbouring motion vectors.

Abstract: A method of motion vector prediction for use in differential motion vector coding within a block motion-compensation-based video coder. The video coder employs a generalized multiple reference picture buffer which may contain multiple reference pictures in both the forward and backward temporal direction from the current picture. For the purpose of coding selections of reference pictures within the buffer, the pictures are organized into two, potentially overlapping, lists of reference pictures. The prediction of a motion vector that selects a reference picture using a given reference picture list is not dependent upon any motion vectors that select their reference pictures using the other reference picture list. The values of spatially neighbouring motion vectors that use the same list of reference pictures as the notion vector being predicted are used for prediction, regardless of the relative temporal direction of the current and neighbouring motion vectors.

Abstract: A system and method is provided to avoid or otherwise reduce luminance and/or chrominance trailing artifacts in block-based hybrid video coders using multiple block sizes and shapes. The proposed trailing artifact avoidance approach has at its core three main components. The first component is a method to identify flat blocks in the source frame that are most susceptible to the appearance of trailing artifacts, and where flatness is determined according to several proposed criteria. The second component is a method to identify bad blocks, which refer to predicted blocks in motion estimation that correspond to flat blocks in the source frame and that contain trailing artifacts. The third component is a method to avoid trailing artifacts when they are detected within a bad block, and where the avoidance is achieved by employing one or more tools from among a proposed set of high fidelity coding tools and/or high performance motion estimation tools.