Abstract: Techniques related to video coding using content based metadata.

Abstract: A system includes a camera to capture real world content and a semiconductor package apparatus. The semiconductor package apparatus includes a substrate and logic. The logic includes a graphics pipeline to generate rendered content, a base layer encoder to encode real world content into a base layer and a first layer encoder to encode rendered content into a first non-base layer, a multiplexer to interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content, and a transmitter to transmit the single output signal. The system further includes a second layer encoder to encode map data into a second non-base layer. The multiplexer to interleave the second non-base layer with the first non-base layer and the base layer. The first and second layer encoders encode the rendered content and the map data into overlay auxiliary pictures.

Abstract: An embodiment of an electronic processing system may include an application processor, persistent storage media communicatively coupled to the application processor, a graphics subsystem communicatively coupled to the application processor, a power budget analyzer to identify a power budget for one or more of the application processor, the persistent storage media, and the graphics subsystem, a target analyzer communicatively coupled to the graphics subsystem to identify a target for the graphics subsystem, and a parameter adjuster to adjust one or more parameters of the graphics subsystem based on one or more of the identified power budget and the identified target.

Abstract: A system includes a camera to capture real world content and a semiconductor package apparatus. The semiconductor package apparatus includes a substrate and logic. The logic includes a graphics pipeline to generate rendered content, a base layer encoder to encode real world content into a base layer and a first layer encoder to encode rendered content into a first non-base layer, a multiplexer to interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content, and a transmitter to transmit the single output signal. The system further includes a second layer encoder to encode map data into a second non-base layer. The multiplexer to interleave the second non-base layer with the first non-base layer and the base layer. The first and second layer encoders encode the rendered content and the map data into overlay auxiliary pictures.

Abstract: Temporal motion vector prediction control is described in video coding. In one example, a method includes receiving a plurality of frames representing encoded video, parsing an uncompressed header for each frame, determining whether a temporal motion vector prediction command is included within the parsed uncompressed header of a first frame, selecting a reference frame from a reference list of frames, retrieving motion vector information from the selected reference frame, performing temporal motion vector prediction on the first frame corresponding to the parsed uncompressed header if a temporal motion vector prediction command is included within the parsed header to form a motion predicted frame, applying a loop filter to the motion predicted frame, and rendering the frame as decoded video.

Abstract: Techniques related to video coding are discussed. Such video coding techniques include applying a projective transformation to a reconstructed reference frame based on scene pose difference data indicative of a scene pose change and performing motion compensation using the reprojected reconstructed reference frame as a motion compensation reference frame.

Abstract: A system includes a camera to capture real world content and a semiconductor package apparatus. The semiconductor package apparatus includes a substrate and logic. The logic includes a graphics pipeline to generate rendered content, a base layer encoder to encode real world content into a base layer and a first layer encoder to encode rendered content into a first non-base layer, a multiplexer to interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content, and a transmitter to transmit the single output signal. The system further includes a second layer encoder to encode map data into a second non-base layer. The multiplexer to interleave the second non-base layer with the first non-base layer and the base layer. The first and second layer encoders encode the rendered content and the map data into overlay auxiliary pictures.

Abstract: Systems, apparatuses and methods may provide for technology to improve user experience when viewing simulated 3D objects on a display. Head and upper-body movements may be tracked and recognized as gestures to alter the displayed viewing angle. The technology provides for a very natural way to look around, under, or over objects.

Abstract: An embodiment of an electronic processing system may include an application processor, persistent storage media communicatively coupled to the application processor, a graphics subsystem communicatively coupled to the application processor, a power budget analyzer to identify a power budget for one or more of the application processor, the persistent storage media, and the graphics subsystem, a target analyzer communicatively coupled to the graphics subsystem to identify a target for the graphics subsystem, and a parameter adjuster to adjust one or more parameters of the graphics subsystem based on one or more of the identified power budget and the identified target.

Abstract: Systems, apparatuses and methods may determine, on a per camera basis, an interest level with respect to panoramic video content, identify a subset of cameras in a plurality of cameras for which the interest level is below a threshold, and reduce power consumption in the subset of cameras. Additionally, technology may determine a projection format associated with panoramic video content, identify one or more discontinuous boundaries in the projection format, and modify an encoding scheme associated with the panoramic video content based on the discontinuous boundaries. Moreover, an encoded frame may be assigned to a temporal scalability layer that has a higher priority than a layer to which an asynchronous space warp frame is assigned. Additionally, technology may reduce the encoding complexity of a boundary between an active region and an inactive region in fisheye content.

Abstract: A system, method, and computer readable medium may include technology to enable optimal usage of automotive virtual mirrors. A gaze detector monitors a driver's eyes to determine if the driver is looking in the direction of a virtual mirror. If the driver is not looking in the direction of virtual mirror, all virtual mirrors are placed in a low operational mode. If the driver is looking in the direction of a virtual mirror, the virtual mirror being viewed is placed in a high operational mode and all other virtual mirrors are placed in the low operational mode.

Abstract: An embodiment of an electronic processing system may include a 2D frame which corresponds to a projection of a 360 video space, and a component predictor to predict an encode component for a first block of a 2D frame based on encode information from a neighboring block which is neighboring to the first block of the 2D frame only in the 360 video space, a prioritizer to prioritize transmission for a second block of the 2D frame based on an identified region of interest, and/or a format detector to detect a 360 video format of the 2D frame based on image content. A 360 video capture device may include a contextual tagger to tag 360 video content with contextual information which is contemporaneous with the captured 360 video content. Other embodiments are disclosed and claimed.

Abstract: Techniques related to deblock filtering for 360 video are discussed. Such video coding techniques include determining, from a 2D video frame that includes a projection from a 360 video space, a group of pixels for deblock filtering including a first set of pixels and a second set of pixels that are non-neighboring sets of pixels in the individual 2D video frame and include a first pixel of the first set of pixels and a second pixel of the second set of pixels that are neighboring pixels in the 360 video space and deblock filtering the group of pixels.

Abstract: Rectilinear viewport extraction from a region of a wide field of view is described using messaging in the video transmission field. Some embodiments pertain to a method that includes receiving a wide field of view video, receiving position data from a remote coupled user device, selecting a region of interest in the video based on the received position data, extracting the region of interest from the video, generating region metadata describing the extracted region of interest, encoding the extracted region of interest of the video, and transmitting the encoded video with the region metadata to the user device.

Abstract: Techniques described herein are related to video coding using display modification input.

Abstract: Techniques related to video coding using content based metadata.

Abstract: A virtual reality panoramic video system is described that uses scalable video coding layers. One example includes a buffer to receive a wide field of view video, a region extractor to extract regions from the wide field of view video, and a scalable multi-layer video encoder to encode the extracted regions as separate layers and to combine the layers to form an encoded video.

Abstract: An adaptive camera resolution system is described for use with matching resolution with compression. In one example, the a method includes capturing a first set of frames of a video sequence at an image sensor at a first resolution, capturing a second set of frames of the video sequence at the image sensor at a second lower resolution, wherein the first and second sets of frames are interleaved, receiving the captured frames at a video encoder, and combining the frames at the video encoder to generate an encoded video sequence of frames with the first resolution.

Abstract: A complete User Datagram Protocol (CUDP) is disclosed that reduces packet loss. Channel frame error information is used with a packet level forward error correction (FEC) coding technique to accommodate wireless multimedia traffic. Each packet, as well as the channel frame error information, is forwarded to a given application. The CUDP protocol further assists the FEC decoding process by forwarding the locations of corrupted frames to the FEC decoder. Maximal Distance Separable (MDS) codes can be applied to a group of packets, to achieve additional robustness. An MDS decoder utilizes the frame error information to recognize the erasures within each packet. The error information can be represented as a set of LTU error indicators associated with each packet (for FEC decoders requiring an erasure indicator). The error indicators point to the starting and ending location of the erroneous data. The error information can also be represented as a reformatted packet (for FEC decoders Recognizing Erasures).

Abstract: Method for increasing the recording time of a digital video tape recorder ("VTR") and for supporting multiple normal play modes of digital VTR operation, e.g., a standard play mode of operation and one or more long play modes of operation. To achieve long play mode operation data reduction is performed on a received full rate video data stream to generate a reduced rate video data stream. Data reduction is performed using data prioritization and selection, requantization of full rate data stream, and/or by selecting data to be included in the reduced rate data stream as a function of what portion of a video frame the data represents. The reduced rate data stream is generated to be compliant with the data format of the full rate data stream. During long play mode recording operation the data in the reduced rate data stream is recorded on a tape at the same tape data density as used during standard mode VTR operation.