Abstract: Different implementations are described, particularly implementations for processing a medium dynamic range video signal are presented. In a method for processing such a video signal a medium dynamic range video signal and associated metadata are received, wherein the metadata include data representative of a peak luminance value of the medium dynamic range video signal. In addition, data representative of a peak luminance value of a presentation display are received. It is determined whether the peak luminance value of the medium dynamic range video signal is greater or lower than the peak luminance value of the presentation display. A processor is configured based on the determination, wherein the processor has a first mode to reconstruct a high dynamic range video signal based on a received standard dynamic range video signal and associated metadata, and a second mode to optimize a received high dynamic range video signal for the rendering device.

Abstract: At least one embodiment relates to a method for adding at least one 3D sample to a point cloud frame and for assigning a color-coding mode to said at least one 3D sample, said color-coding mode indicating if color information associated with said at least one 3D sample is explicitly encoded in a bitstream or if said color information is implicit.

Abstract: A video codec can involve processing video information based on a motion model involving a coding unit including a plurality of sub-blocks, such as an affine motion model, to produce motion compensation information, obtaining a local illumination compensation model, and encoding or decoding the video information based on the motion compensation information and the local illumination compensation model.

Abstract: Systems and methods are described for providing spatial content using a hybrid format. In some embodiments, a client device receives, from a server, surface light field representations of a plurality of scene elements in a 3D scene, including a first scene element. The client device provides to the server an indication of a dynamic behavior of a second scene element different from the first scene element. Further, in response to the indication, the client device receives from the server information defining the first scene element in a 3D asset format. The client device then renders at least the first scene element in the 3D asset format.

Abstract: Described herein are various embodiments for enabling realistic haptic feedback for virtual three-dimensional (3D) objects. A real proxy surface is provided for a virtual object, where the proxy surface may be a relief surface, such as a depth-compressed model of the virtual object. In an exemplary method, when a user touches a proxy surface, a position of the touch point on the surface is detected. The touch point is mapped to a corresponding point on the virtual object. A position of the virtual object is determined such that the touch point is in alignment with the corresponding point on the virtual object, and the virtual object is displayed at the first determined position on an augmented reality display. As a result, a user touching the proxy surface may have the sensation of touching a solid version of the virtual 3D object instead of the proxy surface.

Abstract: The disclosure discloses methods and devices for transmitting and rendering a 3D scene.

Abstract: Methods and apparatus are provided for collaborative partition coding for region based filters. An apparatus includes a video encoder (100) for encoding image data for a plurality of regions in a picture. The video encoder (100) includes multiple filters for filtering the image data based on region partition information for the plurality of regions. The region partition information for the plurality of regions is shared between the multiple filters.

Abstract: There are provided methods and apparatus for adaptive geometric partitioning for video encoding and decoding. An apparatus includes an encoder for encoding image data corresponding to pictures by adaptively partitioning at least portions of the pictures responsive to at least one parametric model. The at least one parametric model involves at least one of implicit and explicit formulation of at least one curve.

Abstract: Systems and methods are described for display of a depth image (depth plus texture) using multiple focal planes. In one embodiment, a depth image (which may be a frame of a depth video, consisting of a video plus depth sequence) is mapped to a first set of image planes. The depth image (or a subsequent frame of the depth video) is mapped to a second set of image planes. Each image plane in the first and second set has a specified depth, and the first and second set differ in at least one depth. Each of the image planes is displayed in the first set at the respective depth of that image plane, and, subsequently, each of the image planes in the second set is displayed at its respective depth. Display of the first and second sets may be cyclically alternated at rate sufficiently high to avoid perceptible flicker.

Abstract: A coding unit having a size multiple of three in horizontal or vertical direction is coded through one of several embodiments. In one embodiment, for some block sizes, the coding unit is coded and decoded systematically through SKIP mode. In another embodiment, the coding units can be coded in SKIP mode or with a DC coefficient. In another embodiment, an asymmetric division of a common coding unit parent is performed and transform coefficients are factorized among at least two sub-blocks to encode a coding unit. In another embodiment, a separable two dimensional transform can be applied by applying a transform over the block in one direction, and using two one- dimensional transforms on sub-blocks in the other direction to code. Methods, apparatus, and signal embodiments are provided for encoding and decoding.

Abstract: A method for reducing the parameters defining an acquired light field ray which enables only the colour associated with the light field ray to be stored instead of 4 light field co-ordinates (x,y,i,j) and its associated colour.

Abstract: An encoding method is presented. Transform coefficients of a block are first obtained. They are then scanned according to a scan pattern for entropy coding. The scan pattern is determined responsive to a shape of the block. FIG.

Abstract: Methods and apparatus are provided for intra coding a block having pixels assigned to groups. An apparatus includes a video encoder for encoding a block in a picture using intra prediction by dividing pixels within the block into at least a first group and a second group and encoding the pixels in the first group prior to encoding the pixels in the second group. A prediction for at least one of the pixels within the second group is obtained by evaluating the pixels within the first group and the second group.

Abstract: Systems and methods are described for capturing, using a forward-facing camera associated with a head-mounted augmented reality (AR) head-mounted display (HMD), images of portions of first and second display devices in an environment, the first and second display devices displaying first and second portions of content related to an AR presentation, and displaying a third portion of content related to the AR presentation on the AR HMD, the third portion determined based upon the images of portions of the first and second display devices captured using the forward-facing camera. Moreover, the first and second display devices may be active stereo display, and the AR HMD may simultaneously function as shutter glasses.

Abstract: A method of predicting or inferring a piece of information for encoding or decoding uses a predictor from a spatial neighbor, or from a reference picture, instead of predicting or inferring the information, such as a flag for a current block, from a motion predictor block. This procedure can be used in several ways, or used in various motion vector prediction modes, such as Frame Rate Up Conversion or various variations of Advanced Motion Prediction. Other embodiments provide other methods and combinations to derive or infer motion information to increase coding efficiency.

Abstract: At least one embodiment relates to a method comprising encoding a projection mode associated with an image region of a first depth image, said projection mode indicating if said image region stores either the minimum or the maximum depth value of at least one orthogonally projected 3D point of the point cloud along a same projection direction; and encoding said depth minimum and maximum depth values as a function of said projection mode.

Abstract: The method for intra frame prediction allows for the recovery of some intra directional modes that are otherwise rendered useless due to the classical padding process. Directional modes are recovered by filling pixel locations in the prediction unit with samples from the portion of the unit that is determined to have samples available for use using a counterpart directional mode to the one that is useless. When it is determined that reference samples are missing for a particular prediction unit or portion thereof given a particular directional mode, a determination is made about whether reference samples along another portion of the prediction unit are available. The other portion is the side of the prediction unit at an opposite end of the particular directional mode.

Abstract: A video encoder or decoder processes portions of video using intra coding and with variable block shapes. Under the general aspects, intra prediction directions are adapted to the block shape or aspect ratio. The general aspects described adaptively replace several conventional angular intra prediction modes with wide-angle intra prediction modes for non-square blocks. The total number of angular directions for any block can remain the same as in prior video coding standards or can be reduced or expanded. To keep the same number of prediction directions, directions along a shorter rectangular edge of a target block are removed but replaced with addition directions along the longer edge of the rectangular target block. For directions with wide angles, reference sample smoothing is performed. Signaling can be provided to inform a corresponding decoder regarding the prediction modes and directions.

Abstract: Methods, apparatus, systems, devices, and computer program products directed to augmenting reality with respect to real-world places, and/or real-world scenes that may include real-world places may be provided. Among the methods, apparatus, systems, devices, and computer program products is a method directed to augmenting reality via a device. The method may include capturing a real-world view that includes a real-world place, identifying the real-world place, determining an image associated with the real-world place familiar to a user of the device viewing the real-world view, and/or augmenting the real-world view that includes the real-world place with the image of the real-world place familiar to a user viewing the real-world view.

Abstract: This method comprises: —orthogonally projecting at least one point of a point cloud along projection lines; and —for at least two points of a same projection line, signaling in a bitstream whether a position of said projection line between a nearer and a farther points of said projection line is occupied or not.