Abstract: At least a method and an apparatus are presented for efficiently encoding or decoding video. For example, one or more chroma residual scaling parameters are determined based one or more luma mapping parameters and based on a corrective value of the one or more chroma residual scaling parameters. The video is encoded or decoded based on the determined one or more chroma residual scaling parameters.

Abstract: Systems, methods, and instrumentalities are disclosed that relate to the processing of a media container file associated with 3D video data. The media container file may indicate that certain video-based point cloud compression (V-PCC) component tracks may be played together as a playout group. These V-PCG component tracks may represent respective encoded versions of one or more V-PCC components, and a video decoding device may play the tracks together in response to determining that the tracks belong to the same playout track group. The video decoding device may also determine from the media container file that certain PCC component tracks include tile groups that correspond to different objects in a point cloud or different parts of a same object in the point cloud. The video decoding device may decode these tile groups independently from each other so that a subset of the objects or parts of the point cloud may be accessed without also accessing the rest of the objects or parts.

Abstract: Methods are described herein for signaling information regarding different viewpoints in a multi-viewpoint omnidirectional media presentation. Techniques disclosed include receiving, from a server, information identifying groups of viewpoints, including information identifying a first group of viewpoints and a second group of viewpoints. And further receiving, from the server, information identifying one or more omnidirectional videos captured from respective viewpoints belonging to the first group and information identifying one or more omnidirectional videos captured from respective viewpoints belonging to the second group.

Abstract: Different implementations are described, particularly implementations for video encoding and decoding based on linear weighted intra prediction, also called matrix based intra prediction, are presented. Accordingly, for a block being encoded or decoded in linear weighted intra prediction, obtaining intra predicted samples from at least two matrix-vector products between at least two selected weight matrices of reduced size and a set of neighboring reference samples. Advantageously, such arrangement allows to reduce the amount of memory for storing data and to reduce the complexity of the intra prediction samples computation.

Abstract: Video content frequently seen in gaming content and having a higher probability of being coded in transform skip mode is coded separately from remaining portions of a video coding block before being combined with regular coded portions. This enables more efficient coding of video by reducing the switching between regular coding modes and transform skip modes. The regular coded portion and the transform skip coded portion are combined in an encoder. At a corresponding decoder, inverse operations occur, such that the transform skipped residual portions are decoded and the regularly coded portions are decoded before the portions are combined for a resultant decoded video block.

Abstract: A method includes decoding a first portion of video data consisting of an information set consisting of information representative of a plurality of candidate sets of sample adaptive offset filter parameters. A set of sample adaptive offset parameters comprises information representative of an offset to be added to a sample value of a current block. A first syntax element representing an index that identifies a first candidate set of the plurality of candidate sets of sample adaptive offset filter parameters is decoded from the video data for the current block. The current block is decoded from a second portion of the video data different from the first portion. The decoded current block is filtered with the first candidate set identified by the index. The first portion is signaled with syntax elements at a level of a block of a group of blocks comprising the current block decoded first in decoding order.

Abstract: A system for user interaction comprising a display including a screen for displaying images, at least one hardware processor for receiving input from at least one sensor detecting at least a position of a user's fingertip in front of the display, the fingertip belonging to a finger extended in a direction of the screen, wherein the at least one hardware processor is configured to determine, from the input from the at least one sensor, an aim of the finger, display on the screen, on condition that the fingertip is in a first zone, at a position corresponding to the aim, an indicator, and select an object displayed in an image on the screen, the object located at the position on the screen corresponding to the aim, on condition that the fingertip is in a second zone, the second zone being closer to the screen than the first zone.

Abstract: A user interface device including memory configured to store instructions and at least one hardware processor configured to execute the instructions to obtain, from at least one sensor, sensor data corresponding to a user gesture, determine a user interface gesture that matches the sensor data, obtain parameters for the determined interface gesture, and upon obtaining the parameters for the determined interface gesture, use the sensor data and the parameters for the determined interface gesture to estimate the user gesture in a user interface. Also provided is a method.

Abstract: A method and apparatus for performing intra prediction for encoding or decoding adds multiple prediction modes to those of prior intra prediction schemes. A horizontal mode, a vertical mode, and a diagonal mode are added. Reference pixels for each of the added modes can come from multiple pixel positions away from a block to be encoded or decoded. Reference pixels to the left and above a block are reconstructed from those already coded. Reference pixels from right of, and below, a block are estimated or extrapolated and can be based on other pixels around the block. An index can be sent in a bitstream indicating which prediction was used.

Abstract: For a bi-prediction block, the initial motion field can be refined using a DNN. In one implementation, the initial motion field is integer rounded to obtain initial prediction blocks. Based on the initial prediction, the DNN can generate motion refinement information, which is scaled and added to the sub-pel residual motion from the initial motion field to generate a refined motion field. The scaling factor can take a default value, or be based on the motion asymmetry. While the initial motion field is usually block based on sub-block based, the refined motion field is pixel based or sub-block based and can be at an arbitrary accuracy. The same refinement process is performed at both the encoder and decoder, and thus the motion refinement information need not to be signaled. Whether the refinement is enabled can be determined based on the initial motion, the block activities and the block size.

Abstract: Systems and methods are disclosed for video encoding and video decoding using decoder-side intra mode derivation (DIMD). Techniques are provided to code and to decode a video block of a video frame into a bitstream, including determining costs of using respective candidate intra prediction modes to predict samples in a template region adjacent to the video block, deriving an intra prediction mode based on candidates of the candidate intra prediction modes and their respective costs, and predicting samples in the current video block using the derived intra prediction mode. The provided techniques further include determining the costs in multiple stages. In an initial stage, the costs of using respective intra prediction modes from an initial set of candidate modes are determined.

Abstract: At least a method and an apparatus are provided for efficiently encoding or decoding video. For example, a plurality of different motion prediction modes are obtained for a current block. The current block is encoded or decoded based on a combination of the plurality of different motion prediction modes with corresponding weights, wherein the combination with the corresponding weights comprising at least two inter prediction modes, or an inter prediction mode and an intra prediction mode. Both triangle prediction and multi-hypothesis prediction are allowed to be indicated in one or more lists of possible motion vector candidates, such as, e.g., in advanced motion vector prediction (AMVP) mode.

Abstract: Embodiments include 3D display devices and methods of operation. In an example device, a light-emitting layer is provided with an addressable array of light-emitting elements. An optical layer overlays the light-emitting layer. The optical layer includes an array of lenses operative to substantially collimate light from the light-emitting layer. To suppress stay light, an angular filter layer is provided along an optical path from the light-emitting layer to an exterior of the display. The angular filter is operative to substantially block light having an incident angle greater than a threshold angle and to substantially transmit light having an incident angle less than a threshold angle. The angular filter may be a thin-film interference bandpass filter. Different regions of the angular filter may be tuned for different wavelengths of light.

Abstract: A method for video decoding is disclosed. A directional intra prediction mode is decoded for a block of a picture, the directional intra prediction mode having a direction. Based on the directional intra prediction mode, a first predictor and a second predictor for a sample in the current block are accessed, the first and second predictors being on a line at least approximating the direction. A sample value of the sample is predicted by interpolation using the first and second predictors, responsive to a difference between the second and first predictors, wherein the difference is scaled by at least a ratio that is based on a location of the sample in the block, and wherein a denominator of the ratio is a power of two regardless of the location of the sample. The sample of the block is reconstructed based on the predicted sample value.

Abstract: Methods and apparatus for using wide-angle intra prediction for rectangular blocks enable greater prediction angles. Wide-angle intra prediction enables intra prediction direction angles beyond the conventional 45 and ?135 degrees. In one embodiment, when a video block to be coded or decoded is non-square, additional intra prediction directions are enabled in the direction of the longer block edge and more reference samples are available along that edge. An index is used to indicate the prediction direction and can be adapted according to the additional intra predictions in the longer direction, with correspondingly fewer prediction directions along the shorter block edge. This preserves the number of prediction modes that need to be indexed but allows their angles to correspond to the shape of the block.

Abstract: According to embodiments, an enhancement layer segment may be requested in addition to a base layer segment for a same video. The enhancement layer may be requested, in a low priority, so that the base layer may be delivered in priority. If the enhancement layer can be obtained by a deadline, a subsequent base layer segment may be requested at a higher quality (e.g., at a bitrate lower than or equal to the sum of the bitrates of the previously requested base layer and enhancement layer segments). If, for example, at a playback time, the enhancement layer segment is not obtained, it may be determined that the quality cannot be increased and subsequent requests for enhancement layer segments may be cancelled (e.g., not transmitted). According to embodiments, probing may repeat (e.g., any of immediately, regularly, periodically, . . . ) to detect available bandwidth variations.

Abstract: A method for video decoding is disclosed. A first reconstructed version of an image block of an encoded video is accessed. The first reconstructed version of said image block is filtered by a first neural network to form a second reconstructed version of said image block to be used as reference. The second reconstructed version of said image block is filtered by a second neural network to form a third reconstructed version of said image block to be displayed. The first and second neural networks are trained jointly.

Abstract: Some embodiments of an apparatus may include: a tracking module configured to track viewer movement adjustments; and a light field image display structure configured to display a light field image using the viewer movement adjustments. Some embodiments of a method may include: projecting a beam spot on a viewer of a light field display; determining an estimated location of the beam spot reflected off the viewer; detecting an actual location of the beam spot reflected off the viewer; and determining image correction parameters based on a comparison of the estimated location and the actual location of the beam spot reflected off the viewer.

Abstract: Several implementations relate to 3D video formats. One or more implementations provide adaptations to MVC and SVC to allow 3D video formats to be used. According to a general aspect, a set of images including video and depth is encoded. The set of images is related according to a particular 3D video format, and are encoded in a manner that exploits redundancy between the set of images. The encoded images are arranged in a bitstream in a particular order, based on the particular 3D video format that relates to the images. The particular order is indicated in the bitstream using signaling information. According to another general aspect, a bitstream is accessed that includes the encoded set of images. The signaling information is also accessed. The set of images is decoded using the signaling information.

Abstract: The disclosure relates to retractable display device (1) including a housing (3) having an internal space (31) defined therein, a rolling axle (32) positioned in the housing (3), an electronic display and a support structure (21) attached to a rear surface of the electronic display. The support structure (21) includes a plurality of juxtaposed support elements (210) capable of being rolled around the axle (32) with the electronic display in a storage position and of being unrolled upward, at least partially out of the housing (3), to provide a substantially planar front surface on which visual information may be displayed.