Abstract: An example apparatus for adaptively encoding video frames includes a network analyzer to predict an instant bitrate based on channel throughput feedback received from a network. The apparatus also includes a content analyzer to generate ladder info based on a received frame. The apparatus further includes an adaptive decision executer to determine a frame rate, a video resolution, and a target frame size based on the predicted instant bitrate and the ladder outputs. The apparatus further includes an encoder to encode the frame based on the frame rate, the video resolution, and the target frame size.

Abstract: An embodiment of an adaptive video encoder may determine headset-related information including at least one of focus-related information and motion-related information and determine one or more video encode parameters based on the headset-related information. The adaptive video encoder may also encode a macroblock of a video image based on the one or more determined video encode parameters. Other embodiments are disclosed and claimed.

Abstract: Described herein is a network and renderer aware split rendering technique that enables a cloud gaming service to split execution of cloud gaming workloads between a graphics processor of a cloud gaming server and a graphics processor of a client of the cloud gaming service. The split rendering technique enables portions of a frame that most vulnerable to quality degradation at low bitrates to be rendered on the client, which results in an improvement of the quality of the final frame that is presented at the client device.

Abstract: Techniques related to video coding with fast low-latency bitstream size control includes detecting outliers and determining a target bitstream size based on the outlier and reinforcement-learning.

Abstract: An embodiment of an adaptive video encoder may include technology to determine headset-related information including at least one of focus-related information and motion-related information, and determine one or more video encode parameters based on the headset-related information. Other embodiments are disclosed and claimed.

Abstract: The disclosure relates to tuning configuration parameters for graphics pipeline for better user experience. A device for graphics processing, comprising: hardware engines; a graphics pipeline at least partly implemented by the hardware engines; and a tuner, coupled to the hardware engines and the graphics pipeline, the tuner to: collect statuses of the device during runtime for a previous frame; determine configuration parameters based on the collected statuses, the configuration parameters associated with three-dimensional 3D rendering, pre-processing and video encoding of the graphics pipeline; and tune the graphics pipeline with the determined configuration parameters for processing a next frame.

Abstract: An embodiment of an adaptive video encoder may include technology to determine headset-related information including at least one of focus-related information and motion-related information, and determine one or more video encode parameters based on the headset-related information. Other embodiments are disclosed and claimed.

Abstract: An embodiment of an adaptive video encoder may include technology to determine headset-related information including at least one of focus-related information and motion-related information, and determine one or more video encode parameters based on the headset-related information. Other embodiments are disclosed and claimed.

Abstract: Embodiments are generally directed to transport controlled video coding. An embodiment of an apparatus includes one or more processors to process data; a memory to store data, including data for video streaming; and a video processing mechanism including an encoder and a transport mechanism, wherein the video processing mechanism is to generate a prediction of channel throughput for a network channel, encode one or more bitstreams based on the prediction, including encoding a plurality of bitstreams including a first bitstream and a second bitstream if the prediction indicates an increase or decrease in channel throughput and encoding a single bitstream if the prediction indicates a stable channel throughput; and select a bitstream of the one or more bitstreams for a current frame.

Abstract: An example apparatus for adaptively encoding video frames includes a network analyzer to predict an instant bitrate based on channel throughput feedback received from a network. The apparatus also includes a content analyzer to generate ladder info based on a received frame. The apparatus further includes an adaptive decision executer to determine a frame rate, a video resolution, and a target frame size based on the predicted instant bitrate and the ladder outputs. The apparatus further includes an encoder to encode the frame based on the frame rate, the video resolution, and the target frame size.

Abstract: An apparatus and method for managing pipes and planes within a virtual graphics processing engine. For example, one embodiment of a graphics processing apparatus comprises: a graphics processor comprising one or more display pipes to render one or more display planes, each of the one or more display pipes comprising a set of graphics processing hardware resources for executing graphics commands and rendering graphics images in the one or more display planes; and pipe and plane management hardware logic to manage pipe and plane assignment, the pipe and plane management hardware logic to associate a first virtual machine (VM) with one or more virtual display planes and to maintain a mapping between the one or more virtual display planes and at least one physical display plane.

Abstract: An apparatus of embodiments, as described herein, includes one or more processors to track data associated with movement of a computing device accessible to a user, and evaluate the data and compare a latency with latency thresholds, where the data indicates the latency and the latency thresholds associated with a frame. The one or more processors are further to maintain a current video encoding rate, if the latency is lower than a first latency threshold and greater than a second latency threshold. The current video encoding rate is decreased if the latency is equal to or greater than the first latency threshold, where the current video encoding rate is increased if the latency is lower than the second latency threshold. The one or more processors are further to present the frame at the computing device including one or more of a wearable device and a mobile device.

Abstract: Techniques are provided for spatial audio streaming using adaptive bitrate encoding and decoding in bandwidth limited virtual reality applications. A methodology implementing the techniques according to an embodiment includes calculating weight factors for audio channels associated with each of a plurality of microphones. The weight factors are based on the position and head angle, relative to the microphones, of a user wearing a head mounted display (HMD). The method also includes encoding and decoding the audio channels, for transmission to the HMD, at a selected bitrate, the bitrate based on the weight factor for the audio channel. The method further includes applying an adaptive gain compensation to each of the received and decoded audio channels, the gain compensation also based on the weight factor. The method further includes mixing the resulting gain compensated channels to generate a stereo audio signal to be played through speakers of the HMD.

Abstract: An embodiment of an adaptive video encoder may include technology to determine headset-related information including at least one of focus-related information and motion-related information, and determine one or more video encode parameters based on the headset-related information. Other embodiments are disclosed and claimed.

Abstract: An embodiment of an adaptive video encoder may include technology to determine headset-related information including at least one of focus-related information and motion-related information, and determine one or more video encode parameters based on the headset-related information. Other embodiments are disclosed and claimed.

Abstract: Embodiments are generally directed to transport controlled video coding. An embodiment of an apparatus includes one or more processors to process data; a memory to store data, including data for video streaming; and a video processing mechanism including an encoder and a transport mechanism, wherein the video processing mechanism is to generate a prediction of channel throughput for a network channel, encode one or more bitstreams based on the prediction, including encoding a plurality of bitstreams including a first bitstream and a second bitstream if the prediction indicates an increase or decrease in channel throughput and encoding a single bitstream if the prediction indicates a stable channel throughput; and select a bitstream of the one or more bitstreams for a current frame.

Abstract: Techniques are disclosed to control a camera device such that memory contention and power consumption is reduced during video processing routines, generally referred to herein as media tasks. In particular, a workload scheduler is implemented in a camera HAL and is configured to dispatch captured image frames in an alternating manner between competing media tasks such that the processing of those image frames is performed sequentially, and thus, eliminates or otherwise mitigates memory contention. To this end, techniques variously disclosed herein can be used to enable low-cost, low-memory configured devices to perform concurrent media tasks on captured high-definition video at high framerates, without an undesirable decrease in performance and an increase in power consumption.

Abstract: Techniques are provided for enhancement of edges in image frames using depth information. A methodology implementing the techniques according to an embodiment includes receiving a color image frame and a depth map frame. The method also includes generating a sharpness mask to control the application of image sharpening to the color pixels. The sharpness mask is based on the value of depth pixels corresponding to the color pixels; and on properties of the depth camera that generated the color image frame, including depth of field, focal distance, and hyperfocal distance. The method further includes calculating sharpness strength for the color pixels. The sharpness strength is proportional to the value of the depth pixel corresponding to the color pixel. The method further includes applying a sharpening filter to the color image frame to enhance edge image features. The sharpening filter is based on the sharpness mask and the sharpness strength.

Abstract: An apparatus of embodiments, as described herein, includes one or more processors to track data associated with movement of a computing device accessible to a user, and evaluate the data and compare a latency with latency thresholds, where the data indicates the latency and the latency thresholds associated with a frame. The one or more processors are further to maintain a current video encoding rate, if the latency is lower than a first latency threshold and greater than a second latency threshold. The current video encoding rate is decreased if the latency is equal to or greater than the first latency threshold, where the current video encoding rate is increased if the latency is lower than the second latency threshold. The one or more processors are further to present the frame at the computing device including one or more of a wearable device and a mobile device.

Abstract: An apparatus and method for managing pipes and planes within a virtual graphics processing engine. For example, one embodiment of a graphics processing apparatus comprises: a graphics processor comprising one or more display pipes to render one or more display planes, each of the one or more display pipes comprising a set of graphics processing hardware resources for executing graphics commands and rendering graphics images in the one or more display planes; and pipe and plane management hardware logic to manage pipe and plane assignment, the pipe and plane management hardware logic to associate a first virtual machine (VM) with one or more virtual display planes and to maintain a mapping between the one or more virtual display planes and at least one physical display plane.