Abstract: Systems and methods are described herein for processing video. An encoder implementing the systems and methods described herein may receive video data comprising a plurality of frames and may partition each frame of the plurality of frames into a plurality of coding units. The encoder may then partition a coding unit into two or more prediction units. The encoder may determine, based on one or more coding parameters, a target bit rate, and characteristics of a human visual system (HVS), a coding mode for each of the two or more prediction units to minimize distortion in the encoded bitstream. The encoder may then determine a residual signal comprising a difference between each of the two or more prediction units and each of one or more corresponding prediction areas in a previously encoded frame and then generate an encoded bitstream comprising the residual signal.

Abstract: A spatial complexity and a temporal complexity associated with one or more frames of media content may be determined. Based on the spatial complexity and the temporal complexity of the media content, a Group of Picture (GOP) size for the one or more frames of the media content may be determined. The GOP size may be inversely proportional to the spatial complexity and the temporal complexity of the one or more frames of media content. Certain frames of the media content may be arranged in a different GOP size as compared to one or more other frames of the media content. By varying the GOP size of the plurality of frames of the media content, the bitrate required to transmit the media content may be decreased without decreasing or substantially decreasing the overall quality of the media content.

Abstract: Systems, methods, and apparatuses are described for processing video. A method may comprise receiving video content comprising a plurality of frames and determining a splitting parameter of a partitioning of at least a portion of a first frame of the plurality of frames. Deblock filtering may be implemented on at least the first frame of the plurality of frames based at least on the splitting parameter.

Abstract: Systems, methods, and apparatuses are described for processing video. Video content comprising a plurality of frames may be received. A viewing parameters associated with playback of the video content may be determined. One or more of luminance pixel data associated with a frame of the plurality of frames and chrominance pixel data associated with the frame is determined. A quantization matrix associated with the frame may be determined based on the viewing parameter and the one or more of luminance pixel data and chrominance pixel data.

Abstract: Methods, systems, and apparatuses are described for streaming content. The embodiments described herein may apply to ABR streaming and output an optimized ABR ladder enabling a playback device to maximize the perceived video quality of received content, provide substantially constant visual quality, and/or minimize rebuffering content. The playback device may request an ABR representation associated with an ABR ladder that has been optimized based on one or more neural networks. The one or more neural networks may be pre-trained based on one or more properties and characteristics/features of the video content. The one or more neural networks may process the video content to dynamically determine parameters such as the bitrates of each ABR representation for the content. The parameters may be used to output the encoded ABR representations.

Abstract: Systems and methods are described herein for processing video. An encoder implementing the systems and methods described herein may receive video data comprising a plurality of frames and may partition each frame of the plurality of frames into a plurality of coding units. The encoder may then partition a coding unit into two or more prediction units. The encoder may determine, based on one or more coding parameters, a target bit rate, and characteristics of a human visual system (HVS), a coding mode for each of the two or more prediction units to minimize distortion in the encoded bitstream. The encoder may then determine a residual signal comprising a difference between each of the two or more prediction units and each of one or more corresponding prediction areas in a previously encoded frame and then generate an encoded bitstream comprising the residual signal.

Abstract: Systems, methods, and apparatuses are described for processing video. A method may comprise receiving video content comprising a plurality of frames and determining a splitting parameter of a partitioning of at least a portion of a first frame of the plurality of frames. Deblock filtering may be implemented on at least the first frame of the plurality of frames based at least on the splitting parameter.

Abstract: A spatial complexity and a temporal complexity associated with one or more frames of media content may be determined. Based on the spatial complexity and the temporal complexity of the media content, a Group of Picture (GOP) size for the one or more frames of the media content may be determined. The GOP size may be inversely proportional to the spatial complexity and the temporal complexity of the one or more frames of media content. Certain frames of the media content may be arranged in a different GOP size as compared to one or more other frames of the media content. By varying the GOP size of the plurality of frames of the media content, the bitrate required to transmit the media content may be decreased without decreasing or substantially decreasing the overall quality of the media content.

Abstract: Methods, systems, and apparatuses for improved adaptation logic and content streaming are described herein. Adaptation logic may allow a client device to request differing representations of content based on at least one service metric related to requesting and/or outputting the content. The client device may receive an indication when at least one frame of the content is encoded using an adaptive resolution change. The client device may determine the at least one service metric based on the indication.

Abstract: Systems, methods, and apparatuses are described for processing video. Video content comprising a plurality of frames may be received. A viewing parameters associated with playback of the video content may be determined. One or more of luminance pixel data associated with a frame of the plurality of frames and chrominance pixel data associated with the frame is determined. A quantization matrix associated with the frame may be determined based on the viewing parameter and the one or more of luminance pixel data and chrominance pixel data.

Abstract: Methods, systems, and apparatuses are described for streaming content. The embodiments described herein may apply to ABR streaming and output an optimized ABR ladder enabling a playback device to maximize the perceived video quality of received content, provide substantially constant visual quality, and/or minimize rebuffering content. The playback device may request an ABR representation associated with an ABR ladder that has been optimized based on one or more neural networks. The one or more neural networks may be pre-trained based on one or more properties and characteristics/features of the video content. The one or more neural networks may process the video content to dynamically determine parameters such as the bitrates of each ABR representation for the content. The parameters may be used to output the encoded ABR representations.

Abstract: Methods, systems, and apparatuses are described for encoding video. Video content to be encoded and sent to a computing device may be downscaled into one or more layers. The one or more layers may represent one or more versions of the video content such as one or more versions encoded at different resolutions. The residuals between each layer and the base layer may be upscaled so that one or more parameters associated with optimizing the encoding of the one or more layers may be determined by one or more neural networks based on the downscaling and upscaling process. The residuals between each layer, the one or more parameters, and the base layer may be encoded and sent to a computing device for decoding and playback of the video content using any of the versions of the video content.

Abstract: An encoder may determine a plurality of coding units associated with a frame of a media file and a plurality of prediction units associated with the frame of the media file. The encoder may determine, based on the plurality of coding units associated with the frame and the plurality of prediction units associated with the frame, and based on a training of the encoder using one or more neural networks, that a particular region of the frame can be encoded using one or more encoding characteristics that are different than the encoding characteristics of one or more other particular regions of the frame. The encoder may allocate one or more encoding resources to the particular region of the frame based on the one or more encoding characteristics of the particular region of the frame in order to reduce the overall media bitrate.

Abstract: Methods, systems, and apparatuses are described for streaming content. The embodiments described herein may apply to ABR streaming and output an optimized ABR ladder enabling a playback device to maximize the perceived video quality of received content, provide substantially constant visual quality, and/or minimize rebuffering content. The playback device may request an ABR representation associated with an ABR ladder that has been optimized based on one or more neural networks. The one or more neural networks may be pre-trained based on one or more properties and characteristics/features of the video content. The one or more neural networks may process the video content to dynamically determine parameters such as the bitrates of each ABR representation for the content. The parameters may be used to output the encoded ABR representations.

Abstract: A spatial complexity and a temporal complexity associated with one or more frames of media content may be determined. Based on the spatial complexity and the temporal complexity of the media content, a Group of Picture (GOP) size for the one or more frames of the media content may be determined. The GOP size may be inversely proportional to the spatial complexity and the temporal complexity of the one or more frames of media content. Certain frames of the media content may be arranged in a different GOP size as compared to one or more other frames of the media content. By varying the GOP size of the plurality of frames of the media content, the bitrate required to transmit the media content may be decreased without decreasing or substantially decreasing the overall quality of the media content.

Abstract: A first quantization value for encoding at least one frame of a content item may be determined based at least on a predetermined bitrate and a point in the content item associated with a scene change. A first duration associated with a first portion of the content item may be determined. The first portion of the content item may comprise the at least one frame and may be associated with the first quantization value. A second quantization value for encoding at least another frame of the content item may be determined based at least on the predetermined bitrate. A second duration associated with a second portion of the content item may be determined. The second portion of the content item may comprise the at least another frame and may be associated with the second quantization value.

Abstract: Systems and methods are described herein for processing video. An encoder implementing the systems and methods described herein may receive video data comprising a plurality of frames and may partition each frame of the plurality of frames into a plurality of coding units. The encoder may then partition a coding unit into two or more prediction units. The encoder may determine, based on one or more coding parameters, a target bit rate, and characteristics of a human visual system (HVS), a coding mode for each of the two or more prediction units to minimize distortion in the encoded bitstream. The encoder may then determine a residual signal comprising a difference between each of the two or more prediction units and each of one or more corresponding prediction areas in a previously encoded frame and then generate an encoded bitstream comprising the residual signal.

Abstract: Methods, systems, and apparatuses for adaptive processing of video content to remove noise, such as film grain noise, without substantially affecting visual presentation quality are described herein. A computing device may determine a plurality of film grain parameters associated with film grain noise present within one or more portions of a content item. The computing device may determine at least one encoding parameter based on the plurality of film grain parameters. The computing device may encode the content item based on the at least one encoding parameter. The computing device may send an encoding message to at least one user device/client device, which may in turn use the encoding message to decode the content item.

Abstract: A spatial complexity and a temporal complexity associated with one or more frames of media content may be determined. Based on the spatial complexity and the temporal complexity of the media content, a Group of Picture (GOP) size for the one or more frames of the media content may be determined. The GOP size may be inversely proportional to the spatial complexity and the temporal complexity of the one or more frames of media content. Certain frames of the media content may be arranged in a different GOP size as compared to one or more other frames of the media content. By varying the GOP size of the plurality of frames of the media content, the bitrate required to transmit the media content may be decreased without decreasing or substantially decreasing the overall quality of the media content.

Abstract: An encoder may determine a plurality of coding units associated with a frame of a media file and a plurality of prediction units associated with the frame of the media file. The encoder may determine, based on the plurality of coding units associated with the frame and the plurality of prediction units associated with the frame, and based on a training of the encoder using one or more neural networks, that a particular region of the frame can be encoded using one or more encoding characteristics that are different than the encoding characteristics of one or more other particular regions of the frame. The encoder may allocate one or more encoding resources to the particular region of the frame based on the one or more encoding characteristics of the particular region of the frame in order to reduce the overall media bitrate.