Abstract: Methods, systems, and apparatuses are described for encoding video. Video content to be encoded and sent to a computing device may be downscaled into one or more layers. The one or more layers may represent one or more versions of the video content such as one or more versions encoded at different resolutions. The residuals between each layer and the base layer may be upscaled so that one or more parameters associated with optimizing the encoding of the one or more layers may be determined by one or more neural networks based on the downscaling and upscaling process. The residuals between each layer, the one or more parameters, and the base layer may be encoded and sent to a computing device for decoding and playback of the video content using any of the versions of the video content.

Abstract: Methods, systems, apparatuses for selecting content applications are described. A manifest file associated with a channel may include content item identifiers associated with content items and content application identifiers associated with content applications that can play the content items. A computing device such as a set-top box may determine one or more content applications to play one or more content items based on the content item identifiers and the content application identifiers in the manifest file.

Abstract: Systems, methods, and apparatuses are described for processing video. Video content comprising a plurality of frames may be received. One or more of luminance pixel data associated with a frame of the plurality of frames and chrominance pixel data associated with the frame may be determined. A viewing parameter associated with playback of the video content may be determined. A contrast sensitivity function (CSF) may be determined based on the frame, the one or more of the luminance pixel data and the chrominance pixel data, and the viewing parameter. A filtered frame may be determined based on the CSF and by applying a filter to a spatial frequency band associated with the frame. The filtered frame may be caused to be output.

Abstract: A first quantization value for encoding at least one frame of a content item may be determined based at least on a predetermined bitrate and a point in the content item associated with a scene change. A first duration associated with a first portion of the content item may be determined. The first portion of the content item may comprise the at least one frame and may be associated with the first quantization value. A second quantization value for encoding at least another frame of the content item may be determined based at least on the predetermined bitrate. A second duration associated with a second portion of the content item may be determined. The second portion of the content item may comprise the at least another frame and may be associated with the second quantization value.

Abstract: Systems, methods, and apparatuses are described for processing video. A method may comprise receiving video content comprising a plurality of frames and determining a splitting parameter of a partitioning of at least a portion of a first frame of the plurality of frames. Deblock filtering may be implemented on at least the first frame of the plurality of frames based at least on the splitting parameter.

Abstract: Methods, systems, apparatuses for selecting content applications are described. A manifest file associated with a channel may include content item identifiers associated with content items and content application identifiers associated with content applications that can play the content items. A computing device such as a set-top box may determine one or more content applications to play one or more content items based on the content item identifiers and the content application identifiers in the manifest file.

Abstract: An encoder may determine a plurality of coding units associated with a frame of a media file and a plurality of prediction units associated with the frame of the media file. The encoder may determine, based on the plurality of coding units associated with the frame and the plurality of prediction units associated with the frame, and based on a training of the encoder using one or more neural networks, that a particular region of the frame can be encoded using one or more encoding characteristics that are different than the encoding characteristics of one or more other particular regions of the frame. The encoder may allocate one or more encoding resources to the particular region of the frame based on the one or more encoding characteristics of the particular region of the frame in order to reduce the overall media bitrate.

Abstract: Methods, systems, apparatuses for selecting content applications are described. A manifest file associated with a channel may include content item identifiers associated with content items and content application identifiers associated with content applications that can play the content items. A computing device such as a set-top box may determine one or more content applications to play one or more content items based on the content item identifiers and the content application identifiers in the manifest file.

Abstract: Methods, systems, and apparatuses are described for encoding video. Video content to be encoded and sent to a computing device may be downscaled into one or more layers. The one or more layers may represent one or more versions of the video content such as one or more versions encoded at different resolutions. The residuals between each layer and the base layer may be upscaled so that one or more parameters associated with optimizing the encoding of the one or more layers may be determined by one or more neural networks based on the downscaling and upscaling process. The residuals between each layer, the one or more parameters, and the base layer may be encoded and sent to a computing device for decoding and playback of the video content using any of the versions of the video content.

Abstract: Methods and systems for in-loop filtering may comprise receiving a video comprising at least one frame. The frame may comprise at least one block of pixels. A content complexity of the block of pixels may be determined. A viewing characteristic of the video may be determined. A number of borders to be filtered may be determined based on at least one of the content complexity or the viewing characteristic. A deblocking filter strength may be determined based on at least one of the content complexity or the viewing characteristic. The number of borders of the block of pixels may be filtered according to the deblocking filter strength.

Abstract: A first quantization value for encoding at least one frame of a content item may be determined based at least on a predetermined bitrate and a point in the content item associated with a scene change. A first duration associated with a first portion of the content item may be determined. The first portion of the content item may comprise the at least one frame and may be associated with the first quantization value. A second quantization value for encoding at least another frame of the content item may be determined based at least on the predetermined bitrate. A second duration associated with a second portion of the content item may be determined. The second portion of the content item may comprise the at least another frame and may be associated with the second quantization value.

Abstract: A spatial complexity and a temporal complexity associated with one or more frames of media content may be determined. Based on the spatial complexity and the temporal complexity of the media content, a Group of Picture (GOP) size for the one or more frames of the media content may be determined. The GOP size may be inversely proportional to the spatial complexity and the temporal complexity of the one or more frames of media content. Certain frames of the media content may be arranged in a different GOP size as compared to one or more other frames of the media content. By varying the GOP size of the plurality of frames of the media content, the bitrate required to transmit the media content may be decreased without decreasing or substantially decreasing the overall quality of the media content.

Abstract: An encoder (e.g., a Versatile Video Coding (VVC) encoder, etc.) may make real-time encoding decisions to vary a bitrate of a content item (e.g., high-resolution video, streaming content, a movie, a show/program, etc.) by upsampling and/or downsampling portions (e.g., frames/slices, group of pictures (GOP), coding units (CU), coding tree units (CTU), etc.) based on a cost function that utilizes a versatile Lagrangian multiplier (denoted as ?v to denote the versatility). The versatile Lagrangian multiplier may not only account for the effects of quantization (e.g., a quantization parameter (QP), etc.) on portions of the content item, instead, the versatile Lagrangian multiplier may also be based on adjustment parameters associated with content resolution and/or playback quality of experience (QoE).

Abstract: Systems, methods, and apparatuses are described for processing video. A method may comprise receiving video content comprising a plurality of frames and determining a splitting parameter of a partitioning of at least a portion of a first frame of the plurality of frames. Deblock filtering may be implemented on at least the first frame of the plurality of frames based at least on the splitting parameter.

Abstract: An encoder may determine a plurality of coding units associated with a frame of a media file and a plurality of prediction units associated with the frame of the media file. The encoder may determine, based on the plurality of coding units associated with the frame and the plurality of prediction units associated with the frame, and based on a training of the encoder using one or more neural networks, that a particular region of the frame can be encoded using one or more encoding characteristics that are different than the encoding characteristics of one or more other particular regions of the frame. The encoder may allocate one or more encoding resources to the particular region of the frame based on the one or more encoding characteristics of the particular region of the frame in order to reduce the overall media bitrate.

Abstract: Methods and systems for in-loop filtering may comprise receiving a video comprising at least one frame. The frame may comprise at least one block of pixels. A content complexity of the block of pixels may be determined. A viewing characteristic of the video may be determined. A number of borders to be filtered may be determined based on at least one of the content complexity or the viewing characteristic. A deblocking filter strength may be determined based on at least one of the content complexity or the viewing characteristic. The number of borders of the block of pixels may be filtered according to the deblocking filter strength.

Abstract: Methods, systems, and apparatuses are described for streaming content. The embodiments described herein may apply to ABR streaming and output an optimized ABR ladder enabling a playback device to maximize the perceived video quality of received content, provide substantially constant visual quality, and/or minimize rebuffering content. The playback device may request an ABR representation associated with an ABR ladder that has been optimized based on one or more neural networks. The one or more neural networks may be pre-trained based on one or more properties and characteristics/features of the video content. The one or more neural networks may process the video content to dynamically determine parameters such as the bitrates of each ABR representation for the content. The parameters may be used to output the encoded ABR representations.

Abstract: An encoder (e.g., a Versatile Video Coding (VVC) encoder, etc.) may make real-time encoding decisions to vary a bitrate of a content item (e.g., high-resolution video, streaming content, a movie, a show/program, etc.) by upsampling and/or downsampling portions (e.g., frames/slices, group of pictures (GOP), coding units (CU), coding tree units (CTU), etc.) based on a cost function that utilizes a versatile Lagrangian multiplier (denoted as ?v to denote the versatility). The versatile Lagrangian multiplier may not only account for the effects of quantization (e.g., a quantization parameter (QP), etc.) on portions of the content item, instead, the versatile Lagrangian multiplier may also be based on adjustment parameters associated with content resolution and/or playback quality of experience (QoE).

Abstract: Systems, methods, and apparatuses are described for processing video. Video content comprising a plurality of frames may be received. A visual element of a first frame of the plurality of frames positioned in an oblique direction relative to one or more of a first axis and a second axis orthogonal to the first axis may be determined. One or more regions associated with the first frame and comprising the visual element may be determined. One or more encoded regions of the first frame may be generated based on partitioning the one or more regions comprising the visual element.

Abstract: A spatial complexity and a temporal complexity associated with one or more frames of media content may be determined. Based on the spatial complexity and the temporal complexity of the media content, a Group of Picture (GOP) size for the one or more frames of the media content may be determined. The GOP size may be inversely proportional to the spatial complexity and the temporal complexity of the one or more frames of media content. Certain frames of the media content may be arranged in a different GOP size as compared to one or more other frames of the media content. By varying the GOP size of the plurality of frames of the media content, the bitrate required to transmit the media content may be decreased without decreasing or substantially decreasing the overall quality of the media content.