Abstract: Methods and apparatus for creating additional affine candidates. Virtual and temporal candidates are determined using neighboring spatial and temporal sub-blocks. The sub-blocks are examined in an order known to both an encoder and a decoder. Valid sub-blocks are used to compute an affine model. The candidates can be filtered and added to a candidate list conditionally based on various criteria. The candidates can be used to determine control point motion vectors and a motion flow field can be determined. Motion vectors for sub-blocks within a video coding block can be determined. Motion compensation can be performed using the improved affine candidates and encoding/decoding based on the improved affine motion compensation.

Abstract: A method for decoding a picture block is disclosed. The decoding method comprises: —decoding (10) at least one stream S_diff into decoded data and into one information for identifying a reconstructed reference picture in a decoder picture buffer; —reconstructing (12) a special reference picture from at least the identified reconstructed reference picture and from the decoded data; —reconstructing (16) the picture block from at least the special reference picture, wherein the at least the special reference picture is not displayed.

Abstract: The present disclosure relates to a method and device for obtaining a second image from a first image when the dynamic range of the luminance of the first image is greater than the dynamic range of the luminance of the second image. The disclosure describes deriving at least one component representative of the colors of the second image from the first image, and maximizing at least one derived component according to a maximum value depending on a linear-light luminance component of the first image.

Abstract: To encode High Dynamic Range (HDR) images, the HDR images can be converted to Low Dynamic Range (LDR) images through tone mapping operation, and the LDR images can be encoded with an LDR encoder. The present principles formulates a rate distortion minimization problem when designing the tone mapping curve. In particular, the tone mapping curve is formulated as a function of the probability distribution function of the HDR images to be encoded and a Lagrangian multiplier that depends on encoding parameters. At the decoder, based on the parameters indicative of the tone mapping function, an inverse tone mapping function can be derived to reconstruct HDR images from decoded LDR images.

Abstract: A decoding method is presented. At least one high level syntax element is decoded that indicates whether generalized bi-prediction applies for predicting blocks of a slice. A block is then decoded from said slice using generalized bi-prediction in the case where said at least one high level syntax element indicates to apply generalized bi-prediction.

Abstract: Systems and methods are described for improved color rendering. In some embodiments, video is captured of a real-world scene, and a region of screen content is detected in the captured video. A processor selectively applies a screen-content color transformation on the region of screen content to generate processed video, and the processed video is displayed substantially in real time, for example on a video-see-through head-mounted display. The screen-content color processing may be different for different types of external displays. The screen-content color processing may also be determined based at least in part on illumination conditions. In some embodiments, the color of displayed virtual objects is adjusted based on visual parameters of the screen content.

Abstract: Program actions may be initiated after detection of a predefined gesture by a user with a real-world object. Users may interact with their physical environment in an augmented reality by detecting interactions with real objects using a combination of location and motion detection, material identification using wearable sensors, or both. Based on detected sensor data from user interaction with a real-world object, a predefined gesture may be identified and a program action associated with that target interaction for the real-world object may be executed. In some cases, the user experience may be enhanced by providing haptic feedback in response to tactile gestures and resulting events.

Abstract: Generating an image from a source image can involve encoding a projection of a part of a three-dimensional scene. Pixels of a source image comprise a depth and a color attribute. Pixels of a source image are de-projected as colored point cloud. A de-projected point in a 3D space has the color attribute of the pixel that it has been de-projected from. Also, a score is attributed to the generated point according to a local depth gradient and/or a local color gradient of the pixel it comes from, the lower the gradient, the higher the score. The generated point cloud is captured by a virtual camera for rendering on a display device. The point cloud is projected onto the viewport image by blending color of points projected on a same pixel, the blending being weighted by the scores of these points.

Abstract: Some embodiments of an example method may include: receiving a manifest file for streaming content, the manifest file identifying one or more degrees of freedom representations of content; tracking bandwidth available; selecting a selected representation from the one or more degrees of freedom representations based on the bandwidth available; retrieving the selected representation; and rendering the selected representation. Some embodiments of the example method may include determining estimated download latency of the one or more degrees of freedom representations. Some embodiments of the example method may include tracking client capabilities. For some embodiments of the example method, selecting the selected representation may be based on the estimated download latency and/or the client capabilities.

Abstract: A method for decoding an image enables to preserve artistic intent at the final rendering stage by adjusting the image to luminance characteristics of the content and of the presentation display that will display the image. Values representative of luminance of both the image and the display device are obtained. Parameters of a display adaptation function are adjusted according to these values and the adjusted display adaptation function is used to decode the image. In at least one embodiment, the adjusted display adaptation function relates to a tone mapping function. Corresponding apparatus implementing the method is also described.

Abstract: Methods and apparatus are provided for determining quantization parameter predictors from a plurality of neighboring quantization parameters. An apparatus includes an encoder for encoding image data for at least a portion of a picture using a quantization parameter predictor for a current quantization parameter to be applied to the image data. The quantization parameter predictor is determined using multiple quantization parameters from previously coded neighboring portions. A difference between the current quantization parameter and the quantization parameter predictor is encoded for signaling to a corresponding decoder.

Abstract: Different implementations are described, particularly implementations for video encoding and decoding based on a linear model responsive to neighboring samples are presented. Accordingly, for a block being encoded or decoded in a picture, at least one spatial neighboring template is determined and at least one linear model parameter is determined based on reconstructed samples of the at least one spatial neighboring template. In a first embodiment, the number N of reconstructed samples corresponds to N=2k with k chosen so that n is the maxim integer smaller than sum of the block width and block height. In a second embodiment, the an offset for the relative position of a first sample in the template among samples of a left, respectively top, neighboring line of the block is determined. In a third embodiment, the number of reconstructed samples is set to a higher number in the larger dimension of the block.

Abstract: The present disclosure relates to a method and device for adapting a video content decoded from elementary streams to the characteristics of a display from at least one type of metadata giving information regarding said elementary streams. Such a method comprises:—obtaining (102) an additional information (HDR DESCR.) indicating the presence of one particular type of metadata;—determining if said video content decoded from elementary streams is display-able on said display (11) from said additional information (HDR DESCR.) and the characteristics of the display (EDID); and—if said video content decoded from elementary streams is determined as being displayable, selecting (105) a process from said additional information and the characteristics of the display and adapting (106) the video content according to the selected process.

Abstract: Systems and methods are described for simulating motion parallax in 360-degree video. In an exemplary embodiment for producing video content, a method includes obtaining a source video, based on information received from a client device, determining a selected number of depth layers, producing, from the source video, a plurality of depth layer videos corresponding to the selected number of depth layers, wherein each depth layer video is associated with at least one respective depth value, and wherein each depth layer video includes regions of the source video having depth values corresponding to the respective associated depth value, and sending the plurality of depth layer videos to the client device.

Abstract: Methods (1100, 1300) and apparatuses (600, 1200) for video coding and decoding are provided. The method of video encoding includes accessing (1110) a reconstructed block corresponding to a block in a picture of a video, determining (1120) at least one filter pattern based on a property of the block and filtering (1130) the reconstructed block according to the at least one filter pattern. The method of video decoding includes accessing (1310) a reconstructed block corresponding to a block in a picture of an encoded video, determining (1320) at least one filter pattern based on a property of the block and filtering (1330) the reconstructed block according to the at least one filter pattern. A bitstream formatted to include encoded data, a computer-readable storage medium and a computer program product are also described.

Abstract: Different implementations are described for determining one or more illumination compensation parameters for a current block being encoded by a video encoder or decoded by a video decoder, based on the selection of one or more neighboring samples. The selection of the one or more neighboring samples is based on information used to reconstruct a plurality of neighboring reconstructed blocks. The selection may be based on the motion information, such as motion vector and reference picture information. In one example, only samples from neighboring reconstructed blocks that have (1) the same reference picture index and/or (2) a motion vector close to the motion vector of the current block is selected. In another example, if the current block derives or inherits some motion information from a top or left neighboring block, then only the top or left neighboring samples are selected for IC parameter calculation.

Abstract: A decoding method is disclosed. First, context for a syntax element associated with a current transform coefficient of a block of a picture is determined. The context is determined based on the area of said block, on the position of the current transform coefficient within the block and on the number of non-zero neighboring transform coefficients in a local template. Second, the syntax element is decoded based at least on the determined context. Advantageously, the local template depends on the shape of said block.

Abstract: Some embodiments of a method may include: identifying two-dimensional (2D) content present in an image of a real-world scene; retrieving metadata comprising depth information associated with the 2D content; generating a plurality of focal plane images using the metadata, the plurality of focal plane images comprising depth cues for the 2D content; and displaying the plurality of focal plane images as a see-through overlay synchronized with the 2D content.

Abstract: A Local illumination compensation system for video encoding and decoding uses memory for storing illumination compensation parameters and does not require access to reconstructed pixels of neighboring blocks. A set of illumination compensation parameters is stored in a dedicated buffer, which is of limited size, and which is decoupled from the coding unit level storage of information. The buffer contains a set of illumination compensation parameters, which may be, for example, computed (or determined in some other manner) on the fly or determined beforehand (for example for example obtained from the video signal or from a device).

Abstract: A decoding method is disclosed. The decoding method comprises: determining an index from a bitstream, the index identifying a coding element in a set of a plurality of coding elements; decoding a picture block from the bitstream using the coding element of the set identified by the index. In a specific embodiment, determining the index comprises: determining, for each coding element in the set, a probability that the coding element was used for encoding the picture block; and determining the index responsive to the determined probabilities.