Abstract: Systems and methods are directed to inpainting video. More specifically, initial video data including a sequence of image frames containing missing or corrupted pixel information may be received. Optical flow displacement values and optical flow validity masks may be generated for neighboring image frames of initial video data. Image features from image feature maps of one or more neighboring image frames may be warp-shifted to image feature maps of a current image frame using the optical flow displacement values and warp-shifted image features from the feature maps of the one or more neighboring image frames may be selected based on one or more of the optical flow validity masks. A sequence of complete image frames may be generated based on the selected warp-shifted image features from the feature maps of the one or more neighboring image frames and image features from the image feature maps of the current image frame.

Abstract: Systems, methods and apparatus for encoding or decoding a file format that stores one or more images are described. One example method includes performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule, where the format rule specifies that first adaptation parameter set network abstraction layer units are disallowed from being simultaneously stored in in the visual media file in (1) any one or both of samples of video coding layer tracks or sample entries of the video coding layer tracks, and (2) samples of non-video coding layer tracks, where the video coding layer tracks are tracks containing video coding layer network abstraction layer units, and where the first adaptation parameter set network abstraction layer units includes luma mapping with chroma scaling parameters for a video stream and scaling list parameters for the video stream.

Abstract: The present disclosure describes techniques for facilitating a collaborative work environment. The techniques comprise creating at least one virtual room accessible by the plurality of users, wherein at least one subset of users are associated with the at least one virtual room, the at least one virtual room enables real-time communications among the at least one subset of users, and the at least one subset of users communicate with each other in the at least one virtual room through a first communication channel; receiving a request from a first user to communicate with at least a second user separately from the first communication channel; and establishing a first sub-communication channel between the first user and the at least a second user while the first communication channel remains accessible to the first user and the at least a second user.

Abstract: Systems, methods and apparatus for processing image data are described. One example method includes performing a conversion between a visual media file and a bitstream. The visual media file comprises image items each comprising a sequence of one or more pictures according to a media file format, and the bitstream comprises access units each comprising one or more pictures each belonging to a layer according to a video coding format. The video coding format defines multiple profiles. The media file format specifies that the bitstream is represented in a file having a specific brand, and that one or more profiles used for representing the video in the bitstream are agnostic of the specific brand.

Abstract: Systems, methods and apparatus for encoding or decoding a file format that stores one or more images are described. One example method includes performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule, where the format rule specifies that first adaptation parameter set network abstraction layer units are disallowed from being simultaneously stored in in the visual media file in (1) any one or both of samples of video coding layer tracks or sample entries of the video coding layer tracks, and (2) samples of non-video coding layer tracks, where the video coding layer tracks are tracks containing video coding layer network abstraction layer units, and where the first adaptation parameter set network abstraction layer units includes luma mapping with chroma scaling parameters for a video stream and scaling list parameters for the video stream.

Abstract: Aspects of the present disclosure provide techniques for derive one or more intra prediction modes (IPMs) from a subset of IPM candidates in order to determine a predictor to use for decoding a block of an image. In some aspects, the subset of IPM candidates may include IPMs that are less than the number of IPMs in a full set of all available IPM candidates (e.g., 67 IPMs in VVC or 35 in HEVC). In some aspects, the subset of IPM candidates may be based on a most probable mode (MPM) list that can be used to determine or signal an IPM based on IPMs previously used in decoding other blocks.

Abstract: Systems, methods and apparatus for processing image data are described. One example method includes performing a conversion between a visual media file and a bitstream. The visual media file comprises image items each comprising a sequence of one or more pictures according to a media file format, and the bitstream includes access units each consisting of one or more pictures each belonging to a layer according to a video coding format. The media file format specifies that image items comprising pictures originated from the bitstream are allowed to be associated with different instances of a property descriptor that indicates high-level characteristics of the bitstream.

Abstract: Example implementations include a method and of video processing, comprising determining, during a conversion between a current video unit of a video and a bitstream of the video, to apply a prediction mode derivation tool to the current video unit, wherein in the prediction mode derivation tool, at least one intra prediction mode (IPM) is derived for the current video unit based on cost calculations between reconstructed samples and prediction samples of a template region related the current video unit. The implementations further include performing the conversion based on the determining.

Abstract: A method implemented by a coding apparatus. The method includes obtaining probabilities of split types being implemented when partitioning a picture, and skipping one or more of the split types based on the probabilities obtained when a coding block is partitioned during a conversion between a video media file and a bitstream. A corresponding apparatus and non-transitory computer readable medium are also provided.

Abstract: The present disclosure describes techniques for facilitating a collaborative work environment. The techniques comprise receiving a request from a first client computing device associated with a first user in the plurality of users to establish a communication with a second user in the plurality of users, the request specifying information associated with the communication; generating and transmitting data to a second client computing device associated with the second user for display of a user interface on the second client computing device, wherein the user interface indicates an invite of communication from the first user, and the user interface comprises information about the first user, the information associated with the communication, and selectable interface elements for accepting or declining the invite; and in response to receiving an indication of acceptance by the second user, establishing a communication channel between the first user and the second user.

Abstract: Systems and methods for generating a video including a plurality of graphic objects provided in a shared environment is described. The method includes acquiring, at a first computing device, a shared session identifier from a shared session manager, the shared session identifier being associated with a first user identifier, receiving a selection of a second user identifier, causing the shared session identifier and the first user identifier to be provided to a second computing device associated with the second user identifier, receiving as input, a first graphic object for rendering to a display associated with the first computing device, the first graphic object being associated with the first user identifier, receiving from a data synchronizer, a second graphic object associated with the second user identifier and the shared session identifier for rendering to the display associated with the second computing device, and generating a video including graphic objects.

Abstract: Systems and methods for rendering a video effect to a display are described. More specifically, video data and audio data are obtained. The video data is analyzed to determine one or more attachment points of a target object that appears in the video data. The audio data is analyzed to determine audio characteristics. A video effect associated with an animation to be added to the one or more attachment points is determined based on the audio characteristics. A rendered video is generated by applying the video effect to the video data.

Abstract: Systems and methods for social networking using augmented reality are disclosed. A network may receive, from a plurality of client devices, a request to connect to a server. The server may be associated with an object, such as a landmark or a product. The server may serialize an AR world including the object and content associated with the object and send, to the plurality of client devices, data indicative of the AR world. The server via network may receive, from a first client device among the plurality of client devices, an indication of user input associated with the AR world. The indication of user input may comprise text data, digital image data, or user feedback. The indication of user input may be broadcast to the plurality of client devices.

Abstract: Systems and method directed to performing video object segmentation are provided. In examples, video data representing a sequence of image frames and video data representing an object mask may be received at a video object segmentation server. Image features may be generated based on a first image frame of the sequence of image frames, image features may be generated based on a second image frame of the sequence of image frames; and object features may be generated based on the object mask. A transform matrix may be computed based on the image features of the first image frame and image features of the second image frame; the transform matrix may be applied to the object features resulting in transformed object features. A predicted object mask associated with the second image frame may be obtained by decoding the transformed object features.

Abstract: Systems and methods for rendering a video effect to a display are described. More specifically, video data and audio data are obtained. The video data is analyzed to determine one or more attachment points of a target object that appears in the video data. The audio data is analyzed to determine audio characteristics. A video effect associated with an animation to be added to the one or more attachment points is determined based on the audio characteristics. A rendered video is generated by applying the video effect to the video data.