Abstract: A point cloud data transmitting method according to embodiments can comprise the steps of encoding point cloud data and transmitting a bitstream including the point cloud data. A point cloud data receiving method according to embodiments can comprise the steps of receiving a bitstream including point cloud data, decoding the point cloud data, and rendering the point cloud data.

Abstract: Systems and methods are described for reducing the complexity of using bi-directional optical flow (BIO) in video coding. In some embodiments, bit-width reduction steps are introduced in the BIO motion refinement process to reduce the maximum bit-width used for BIO calculations. In some embodiments, simplified interpolation filters are used to generate predicted samples in an extended region around a current coding unit. In some embodiments, different interpolation filters are used for vertical versus horizontal interpolation. In some embodiments, BIO is disabled for coding units with small heights and/or for coding units that are predicted using a sub-block level inter prediction technique, such as advanced temporal motion vector prediction (ATMVP) or affine prediction.

Abstract: A system can use a video analytic algorithm and/or other input parameters to identify an event (e.g., theft). Optionally, the system can take action in response. For example, the security system can use video analytics to determine that a person has reached into a shelf multiple times at a rate above a threshold, which can indicate that a thief is quickly removing items from the shelf. A monitoring system can monitor other areas for breaches, such as an entrance to a store or residence. Monitoring entrances and/or exits can be used to determine occupancy, or to determine rush events to prompt customer service action, such as opening additional point of sale stations.

Abstract: Innovations in adaptive encoding and decoding for units of a video sequence can improve coding efficiency when switching between color spaces during encoding and decoding. For example, some of the innovations relate to adjustment of quantization or scaling when an encoder switches color spaces between units within a video sequence during encoding. Other innovations relate to adjustment of inverse quantization or scaling when a decoder switches color spaces between units within a video sequence during decoding.

Abstract: A video data stream having a video encoded thereinto and is described. It includes first timing information on first coded picture buffer, CPB, removal times to be applied at decoder side in case of buffering a complete version of the video data stream, and second timing information on second CPB removal times to be applied at decoder side for buffering a reduced version of the video data stream, differing from the video data stream by removal of a portion of the video data stream from the complete version of the video data stream. Corresponding video encoders, video decoders, network nodes, apparatuses for managing the coded picture buffer, CPB, of a video decoder, and apparatuses for splicing together video data streams are also referred to.

Abstract: Methods and apparatus for video coding are disclosed. According to one method, First ALF (Adaptive Loop Filter) processing is applied to the reconstructed chroma samples for a target reconstructed chroma sample to generate a first filtered chroma sample. Second ALF processing is applied to the related reconstructed luma samples to generate a second filtered chroma sample for the target reconstructed chroma sample, where positions of the related reconstructed luma samples selected for the second ALF processing are determined according to the target chroma format. According to another method, the luma ALF and the cross-component ALF have the same filter coefficient precision.

Abstract: A video coding mechanism is disclosed. The mechanism includes encoding a sequence of point cloud compression (PCC) components into a bitstream. A buffering period supplemental enhancement information (SEI) message is also encoded into the bitstream. A hypothetical reference decoder (HRD) is initialized at a coded atlas access unit (AU) associated with the buffering period SEI message. A HRD conformance check of the bitstream is performed starting at the coded atlas AU. The bitstream is stored for communication toward a decoder.

Abstract: The present disclosure relates to an information processing apparatus and an information generation method that enable suppression of deterioration in subjective quality of a point cloud. There is generated an occupancyMap indicating, for each local area of a frame image, presence or absence of a projection image of a point cloud on a two-dimensional plane in accordance with a positional relationship of points in a three-dimensional space, while the point cloud represents an object having a three-dimensional shape as a set of the points. The present disclosure can be applied to, for example, an information processing apparatus, an encoding device, a decoding device, or the like.

Abstract: An embodiment mobility guidance system includes a sensor provided in a mobility and configured to capture a driving video or an image to transmit the driving video or the image, a memory configured to store a danger zone image, a detector configured to compare the driving video or the image captured by the sensor with the danger zone image stored in the memory to detect an existence of a danger zone on a driving path of the mobility, and a guide configured to set a guide zone in response to the detector detecting the existence of the danger zone and a change in a speed or an acceleration of the mobility, and to provide the guide zone to a second mobility.

Abstract: An image decoding method according to the present document comprises the steps of: acquiring, from a bitstream, reference line index information indicating a reference line to be used for intra prediction of a current block; constructing a most probable mode (MPM) list by deriving candidate intra prediction modes of the current block on the basis of the value of the reference line index information; deriving the intra prediction mode of the current block on the basis of the MPM list; generating prediction samples for the current block on the basis of the intra prediction mode; and generating restoration samples for the current block on the basis of the prediction samples, wherein, on the basis of the case in which the value of the reference line index information is not zero, one of the candidate intra prediction modes is a DC mode and the number of candidate intra prediction modes including the DC mode is 5.

Abstract: A method of performing motion vector prediction for a current block in a picture is provided which includes: deriving a candidate for a motion vector predictor to code a current motion vector of the current block, from a first motion vector of a first block that is spatially adjacent or temporally adjacent to the current block; adding the derived candidate to a list of candidates; and deriving at least one motion vector predictor based on a selected candidate from the list of candidates, wherein the deriving of the candidate includes determining whether to derive the candidate from the first motion vector, based on a type of a current reference picture and a type of a first reference picture, the current reference picture being referred to from the current block using the current motion vector, the first reference picture being referred to from the first block using the first motion vector.

Abstract: This disclosure relates to video coding and more particularly to techniques for signaling types of pictures for coded video. In particular, this disclosure describes techniques for enabling and signaling a so-called gradual random access picture. According to an aspect of an invention, a second syntax element is decoded by using a value of a first syntax element wherein the first syntax element indicates a picture is a random access picture having a recovery point picture and the second syntax element specifies a first picture order count value of the recovery point picture.

Abstract: A system for registering one or more cameras and/or creating an accurate three-dimensional (3D) model of a world space environment including back projecting at least one image from at least one of a plurality of camera views to the 3D model based on a set of existing camera parameters. The back projected image is added as a texture for the 3D model. This texture is automatically compared to one or more images from other camera views using a color space comparison of images to determine a set of differences or errors. The camera parameters and the 3D model are automatically adjusted to minimized the differences or errors. Over time, the parameters and the 3D model converge on a state that can be used to track moving objects, insert virtual graphics and/or perform other functions.

Abstract: Methods and apparatus for supporting the capture of images of surfaces of an environment visible from a default viewing position and capturing images of surfaces not visible from the default viewing position, e.g., occluded surfaces, are described. Occluded and non-occluded image portions are packed into one or more frames and communicated to a playback device for use as textures which can be applied to a model of the environment where the images were captured. An environmental model includes a model of surfaces which are occluded from view from a default viewing position but which maybe viewed is the user shifts the user's viewing location. Occluded image content can be incorporated directly into a frame that also includes non-occluded image data or sent in frames of a separate, e.g., auxiliary content stream that is multiplexed with the main content stream which communicates image data corresponding to non-occluded environmental portions.

Abstract: An example device for retrieving media data, the device comprising: a memory configured to store scene data and image data; and one or more processors implemented in circuitry and configured to: receive data for a bitstream indicating that the bitstream includes one or more overlay images, the overlay images comprising either a single static image to be presented with scene data that remains constant while being presented frame-by-frame with frames of the scene data or an image sequence that repeats with a regular periodicity while being presented frame-by-frame with the frames of the scene data; receive the one or more overlay images from the bitstream; receive the scene data including one or more scene images; and present the scene images and the overlay images.

Abstract: Responsive to a zoom command when presenting a first video, a second video is combined with the first video and presented. The first and second videos are generated from substantially the same camera location as each other at substantially the same time with substantially the same resolution. However, the second video is generated by a physical or virtual lens having a field of view (FOV) smaller than the FOV of a physical or virtual lens used in generating the first video. The technique gives the appearance of zooming without loss of resolution.

Abstract: Methods, apparatus and systems for geometric matching of virtual reality (VR) or augmented reality (AR) output contemporaneously with video output formatted for display on a 2D screen include a determination of value sets that when used in image processing cause an off-screen angular field of view of the at least one of the AR output object or the VR output object to have a fixed relationship to at least one of the angular field of view of the onscreen object or of the 2D screen. The AR/VR output object is outputted to an AR/VR display device and the user experience is improved by the geometric matching between objects observed on the AR/VR display device and corresponding objects appearing on the 2D screen.

Abstract: Gaze is corrected by adjusting multi-view images of a head. Image patches containing the left and right eyes of the head are identified and a feature vector is derived from plural local image descriptors of the image patch in at least one image of the multi-view images. A displacement vector field representing a transformation of an image patch is derived, using the derived feature vector to look up reference data comprising reference displacement vector fields associated with possible values of the feature vector produced by machine learning. The multi-view images are adjusted by transforming the image patches containing the left and right eyes of the head in accordance with the derived displacement vector field.

Abstract: A method comprising: obtaining a configuration of at least one neural network comprising a plurality of intra-prediction mode agnostic layers and one or more intra-prediction mode specific layers, the one or more intra-prediction mode specific layers corresponding to different intra-prediction modes; obtaining at least one input video frame comprising a plurality of blocks; determining to encode one or more blocks using intra prediction; determining an intra-prediction mode for each of said one or more blocks; grouping blocks having same intra-prediction mode into groups, each group being assigned with a computation path among the plurality of intra-prediction mode agnostic and the one or more intra-prediction mode specific layers; training the plurality of intra-prediction mode agnostic and/or the one or more intra-prediction mode specific layers of the neural networks based on a training loss between an output of the neural networks relating to a group of blocks and ground-truth blocks, wherein the ground-t

Abstract: The information processing apparatus includes: one or more processors functioning by executing instructions stored in one or more memories as the following units: an obtaining unit configured to obtain information for specifying a display device that displays a virtual viewpoint image whose virtual viewpoint can be changed; and a determining unit configured to determine a virtual viewpoint position in accordance with a display device specified based on information obtained by the obtaining unit.