Abstract: Techniques related to video coding using content based metadata.

Abstract: Systems, apparatuses and methods may determine, on a per camera basis, an interest level with respect to panoramic video content, identify a subset of cameras in a plurality of cameras for which the interest level is below a threshold, and reduce power consumption in the subset of cameras. Additionally, technology may determine a projection format associated with panoramic video content, identify one or more discontinuous boundaries in the projection format, and modify an encoding scheme associated with the panoramic video content based on the discontinuous boundaries. Moreover, an encoded frame may be assigned to a temporal scalability layer that has a higher priority than a layer to which an asynchronous space warp frame is assigned. Additionally, technology may reduce the encoding complexity of a boundary between an active region and an inactive region in fisheye content.

Abstract: Spherical rotation is described for encoding a video that has a wide field of view, such as a spherical or hemispherical video. One example relates to receiving encoded video including rotation orientation metadata, decoding the video, extracting the rotation orientation metadata, rotating the decoded video based on the rotation orientation metadata, generating a view of the rotated decoded video, and buffering the generated view for display.

Abstract: An embodiment of an electronic processing system may include an application processor, persistent storage media communicatively coupled to the application processor, a graphics subsystem communicatively coupled to the application processor, a power budget analyzer to identify a power budget for one or more of the application processor, the persistent storage media, and the graphics subsystem, a target analyzer communicatively coupled to the graphics subsystem to identify a target for the graphics subsystem, and a parameter adjuster to adjust one or more parameters of the graphics subsystem based on one or more of the identified power budget and the identified target.

Abstract: Systems, apparatuses and methods may provide for technology to improve user experience when viewing simulated 3D objects on a display. Head and upper-body movements may be tracked and recognized as gestures to alter the displayed viewing angle. The technology provides for a very natural way to look around, under, or over objects.

Abstract: Rectilinear viewport extraction from a region of a wide field of view is described using messaging in the video transmission field. Some embodiments pertain to a method that includes receiving a wide field of view video, receiving position data from a remote coupled user device, selecting a region of interest in the video based on the received position data, extracting the region of interest from the video, generating region metadata describing the extracted region of interest, encoding the extracted region of interest of the video, and transmitting the encoded video with the region metadata to the user device.

Abstract: Rectilinear viewport extraction from a region of a wide field of view is described using messaging in the video transmission field. Some embodiments pertain to a method that includes receiving a wide field of view video, receiving position data from a remote coupled user device, selecting a region of interest in the video based on the received position data, extracting the region of interest from the video, generating region metadata describing the extracted region of interest, encoding the extracted region of interest of the video, and transmitting the encoded video with the region metadata to the user device.

Abstract: An embodiment of an electronic processing system may include a 2D frame which corresponds to a projection of a 360 video space, and a component predictor to predict an encode component for a first block of a 2D frame based on encode information from a neighboring block which is neighboring to the first block of the 2D frame only in the 360 video space, a prioritizer to prioritize transmission for a second block of the 2D frame based on an identified region of interest, and/or a format detector to detect a 360 video format of the 2D frame based on image content. A 360 video capture device may include a contextual tagger to tag 360 video content with contextual information which is contemporaneous with the captured 360 video content. Other embodiments are disclosed and claimed.

Abstract: Spherical rotation is described for encoding a video that has a wide field of view, such as a spherical or hemispherical video. One example relates to receiving encoded video including rotation orientation metadata, decoding the video, extracting the rotation orientation metadata, rotating the decoded video based on the rotation orientation metadata, generating a view of the rotated decoded video, and buffering the generated view for display.

Abstract: A suggested viewport indication is generated and sent for use in a panoramic video. In one example, a method includes receiving encoded video including viewport metadata, decoding the video, extracting the viewport metadata, generating a viewport of the decoded video based on the viewport metadata, and buffering the generated viewport for display.

Abstract: Disclosed examples include at least one processor to: access frames captured at a first resolution by an image sensor; reduce ones of the frames to a second resolution lower than the first resolution, the ones of the frames at the second resolution interleaved with the frames at the first resolution in an interleaved video sequence; and buffer the interleaved video sequence; and a video encoder to: access the interleaved video sequence; and generate an encoded video sequence of frames at the first resolution by combining the frames of the interleaved video sequence.

Abstract: An embodiment of an electronic processing system may include an application processor, persistent storage media communicatively coupled to the application processor, a graphics subsystem communicatively coupled to the application processor, a power budget analyzer to identify a power budget for one or more of the application processor, the persistent storage media, and the graphics subsystem, a target analyzer communicatively coupled to the graphics subsystem to identify a target for the graphics subsystem, and a parameter adjuster to adjust one or more parameters of the graphics subsystem based on one or more of the identified power budget and the identified target.

Abstract: Systems, apparatuses and methods may provide for technology to improve user experience when viewing simulated 3D objects on a display. Head and upper-body movements may be tracked and recognized as gestures to alter the displayed viewing angle. The technology provides for a very natural way to look around, under, or over objects.

Abstract: Spherical rotation is described for encoding a video that has a wide field of view, such as a spherical or hemispherical video. One example relates to receiving encoded video including rotation orientation metadata, decoding the video, extracting the rotation orientation metadata, rotating the decoded video based on the rotation orientation metadata, generating a view of the rotated decoded video, and buffering the generated view for display.

Abstract: A suggested viewport indication is generated and sent for use in a panoramic video. In one example, a method includes receiving encoded video including viewport metadata, decoding the video, extracting the viewport metadata, generating a viewport of the decoded video based on the viewport metadata, and buffering the generated viewport for display.

Abstract: An example apparatus for encoding immersive video includes a view optimizer to receive a plurality of input views from a source camera and select basic views and additional views from the plurality of input views. The apparatus also includes a view pruner to prune the additional views based on a comparison with the basic views. The apparatus further includes a patch packer to generate atlases based on the pruned additional views and the basic views. The apparatus includes a metadata composer to generate metadata including additional metadata. The apparatus also further includes a bitstream generator to generate a bitstream including the encoded video and the metadata.

Abstract: A system, method, and computer readable medium may include technology to enable optimal usage of automotive virtual mirrors. A gaze detector monitors a driver's eyes to determine if the driver is looking in the direction of a virtual mirror. If the driver is not looking in the direction of virtual mirror, all virtual mirrors are placed in a low operational mode. If the driver is looking in the direction of a virtual mirror, the virtual mirror being viewed is placed in a high operational mode and all other virtual mirrors are placed in the low operational mode.

Abstract: A suggested viewport indication is generated and sent for use in a panoramic video. In one example, a method includes receiving encoded video including viewport metadata, decoding the video, extracting the viewport metadata, generating a viewport of the decoded video based on the viewport metadata, and buffering the generated viewport for display.

Abstract: A system includes a camera to capture real world content and a semiconductor package apparatus. The semiconductor package apparatus includes a substrate and logic. The logic includes a graphics pipeline to generate rendered content, a base layer encoder to encode real world content into a base layer and a first layer encoder to encode rendered content into a first non-base layer, a multiplexer to interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content, and a transmitter to transmit the single output signal. The system further includes a second layer encoder to encode map data into a second non-base layer. The multiplexer to interleave the second non-base layer with the first non-base layer and the base layer. The first and second layer encoders encode the rendered content and the map data into overlay auxiliary pictures.

Abstract: An adaptive camera resolution system is described for use with matching resolution with compression. In one example, the a method includes capturing a first set of frames of a video sequence at an image sensor at a first resolution, capturing a second set of frames of the video sequence at the image sensor at a second lower resolution, wherein the first and second sets of frames are interleaved, receiving the captured frames at a video encoder, and combining the frames at the video encoder to generate an encoded video sequence of frames with the first resolution.