Abstract: A method comprises obtaining media content associated with a first viewpoint and a second viewpoint, wherein a first position of the first viewpoint is static and a second position of the second viewpoint is dynamic; generating a first VWPT descriptor based on the media content and describing the first viewpoint; generating a second VWPT descriptor based on the media content and describing the second viewpoint; generating an MPD comprising the first VWPT descriptor and the second VWPT descriptor; and transmitting the MPD.

Abstract: This application provides a video processing method and apparatus. The method includes: adding, by a server, perception attribute information of an object and spatial location information of the object to a video bitstream or a video file, and encapsulating the video bitstream or the video file, where the perception attribute information is used to indicate a property presented when the object is perceived by a user; and obtaining, by a terminal device, the video bitstream or the video file that carries the perception attribute information of the object and the spatial location information of the object, and performing perception rendering on a perception attribute of the object based on behavior of the user, the perception attribute information of the object and the spatial location information of the object.

Abstract: A video picture encoding and decoding method, including obtaining a primary sub-region bitstream corresponding to a target sub-picture of a panoramic picture, where the primary sub-region bitstream includes N secondary sub-region bitstreams, and N is a positive integer, parsing the primary sub-region bitstream to obtain a reconstructed picture, performing cross-sub-region-boundary out-loop filtering on the reconstructed picture when an out-loop filtering identifier instructs to perform cross-sub-region-boundary out-loop filtering on the reconstructed picture, to obtain a filtered reconstructed picture, and adjusting a location of at least one of N sub-regions in the filtered reconstructed picture to obtain a picture having no sub-region boundary.

Abstract: This application provides encoding and decoding methods and apparatuses for an enhancement layer. The encoding method includes: an encoder obtains a reconstructed block of a base layer of a to-be-encoded picture block; calculates a difference between corresponding pixels in the to-be-encoded picture block and the reconstructed block of the base layer to obtain a residual block of an enhancement layer of the to-be-encoded picture block; determines a transform-block partitioning manner of the residual block of the enhancement layer; and performs transformation on the residual block of the enhancement layer based on the transform-block partitioning manner. This application can simplify a processing procedure for the encoder and improve encoding efficiency of the encoder. In addition, compression efficiency of the residual block can be improved more effectively by using an adaptive TU partitioning method.

Abstract: Embodiments of this application disclose an encoding and decoding method including: Each of multiple viewpoint bitstreams includes a first type bitstream and a second type bitstream; when a first image frame in a first type bitstream of a first viewpoint bitstream is played, receiving a switching request that indicates to play a second viewpoint bitstream; determining a first random access frame that is in a first type bitstream and/or a second type bitstream of the second viewpoint bitstream and whose play moment is after and closest to the first image frame; decoding to obtain the first random access frame based on encoded data of the first random access frame in the second viewpoint bitstream, and decoding to obtain and play an image frame that is in the first type bitstream of the second viewpoint bitstream by using the first random access frame as a reference frame.

Abstract: Example video data processing methods and apparatus are disclosed. One example method includes receiving a first stream from a client, where the first bitstream is obtained by encoding image data in a specified spatial object. The specified spatial object is part of panoramic space, and a size of the specified spatial object is larger than a size of a spatial object of the panoramic space corresponding to viewport information. The spatial object corresponding to the viewport information is located in the specified spatial object. The client receives a second stream, where the second bitstream is obtained by encoding image data of a panoramic image of the panoramic space with a lower resolution than a resolution of the image data included in the specified spatial object. The client plays the second bitstream and first bitstream.

Abstract: A video picture processing method includes: sampling an initial picture, to obtain a target picture; dividing the target picture, to obtain a plurality of sub-pictures; extending picture borders of a first-category sub-picture, to obtain an extended first-category sub-picture; downsampling the extended first-category sub-picture, to obtain a downsampled first-category sub-picture; encoding a second-category sub-picture and the downsampled first-category sub-picture, to obtain bitstreams; and writing location information and extension information of the plurality of sub-pictures into the bitstreams, where extension information of the first-category sub-picture is used to indicate that the picture borders of the first-category sub-picture have been extended and indicate extension widths of the picture borders, and extension information of the second-category sub-picture is used to indicate that picture borders of the second-category sub-picture have not been extended.

Abstract: A media information processing method includes obtaining media description information, where the media description information includes description information of at least two bitstreams corresponding to a first picture area, any one of the at least two bitstreams has an access point different in time from an access point of another bitstream in the at least two bitstreams, the at least two bitstreams are bitstreams obtained by separately encoding picture content of the first picture subarea, and time periods corresponding to the picture content separately encoded by the at least two bitstreams overlap, and determining, based on the media description information, a to-be-played first target bitstream, where the first target bitstream is one of the at least two bitstreams.

Abstract: An image processing method includes determining, based on a coordinate position of a to-be-interpolated sample in a target image, a first coordinate position of the to-be-interpolated sample in a source image, determining m reference samples based on the first coordinate position, determining an interpolation weight of each of the m reference samples for the to-be-interpolated sample based on a spherical distance between a coordinate position of each of the m reference samples and the first coordinate position, and determining a pixel value of the to-be-interpolated sample based on a pixel value corresponding to each of the m reference samples and the interpolation weight of each of the m reference samples for the to-be-interpolated sample to obtain the target image.

Abstract: This application provides a media data transmission method and apparatus. The method includes: receiving, by a client, a media presentation description (MPD) file, where the MPD file includes priority indication information, and the priority indication information is used to indicate a priority or priorities of one or more overlays; and processing, by the client, the one or more overlays based on the priority indication information.

Abstract: A viewpoint image processing method and a related device are provided, and relate to the artificial intelligence/computer vision field. The method includes: obtaining a preset quantity of first viewpoint images; obtaining a geometric feature matrix between the preset quantity of first viewpoint images; generating an adaptive convolution kernel corresponding to each pixel of the preset quantity of first viewpoint images based on the geometric feature matrix and location information of a to-be-synthesized second viewpoint image, where the location information represents a viewpoint location of the second viewpoint image; generating the preset quantity of to-be-processed virtual composite pixel matrices based on the adaptive convolution kernels and the pixels of the preset quantity of existing viewpoint images; and synthesizing the second viewpoint image by using the preset quantity of to-be-processed virtual composite pixel matrices.

Abstract: A media data transmission method and an apparatus. The method includes: A client sends first information to a server. The client receives video data packets that correspond to a second target video picture and that are sent by the server. The first information is used to indicate spatial information of a region in which a first target video picture is located, and the first target video picture includes a video picture within a current viewport. The second target video picture includes the first target video picture, at least one of the video data packets corresponding to the second target video picture carries at least one piece of second information, and the second information is used to indicate spatial information of a region in which the second target video picture is located.

Abstract: A media information processing method includes obtaining sub-bitstream data, where the sub-bitstream data includes indication information, and the indication information is used to indicate an amount of tile data included in the sub-bitstream data, or the indication information is used to indicate whether the sub-bitstream data can be used for splicing, and processing the sub-bitstream data based on the indication information.

Abstract: Example video data processing methods and apparatus are disclosed. One example method includes receiving a first stream from a client, where the first bitstream is obtained by encoding image data in a specified spatial object. The specified spatial object is part of panoramic space, and a size of the specified spatial object is larger than a size of a spatial object of the panoramic space corresponding to viewport information. The spatial object corresponding to the viewport information is located in the specified spatial object. The client receives a second stream, where the second bitstream is obtained by encoding image data of a panoramic image of the panoramic space with a lower resolution than a resolution of the image data included in the specified spatial object. The client plays the second bitstream and first bitstream.

Abstract: This disclosure provides an image encoding method and apparatus and an image decoding method and apparatus. For a to-be-encoded image in a to-be-encoded video sequence, a reference image may be selected from at least one knowledge-base image in a knowledge-base image set. In addition, bitstream data of the to-be-encoded image includes identification information used to identify the reference image of the to-be-encoded image.

Abstract: Embodiments of the present invention describe streaming media transmission methods and apparatus applied to a virtual reality technology. A method for streaming media transmissions may include sending a media information obtaining request to a server, where the media information obtaining request includes client capability information and auxiliary information, the client capability information indicates that the client supports reception of data pushed by the server, and the auxiliary information indicates an attribute that the client supports virtual reality presentation. The method may also include receiving a media presentation description and media data, where the media presentation description and the media data are sent by the server after the server responds to the media information obtaining request.

Abstract: Example video data processing methods and apparatus are disclosed. One example method includes obtaining viewport information by a server. The server obtains spatial object information based on the viewport information, where the spatial object information is used to describe a specified spatial object in panoramic space. The server obtains a first bitstream, where the first bitstream is obtained by encoding image data in the specified spatial object. The server obtains a second bitstream, where the second bitstream is obtained by encoding image data in the panoramic space. The server transmits the first bitstream and the second bitstream to a client.

Abstract: This application provides a spherical image processing method which includes: obtaining a spherical image and determining a sphere center of the spherical image; determining a viewpoint of a user when the user views the spherical image, where the viewpoint is located at any point, other than the sphere center, in a sphere space surrounded by the spherical image; determining a pixel expansion region and a pixel shrinkage region on the spherical image based on the sphere center and the viewpoint; and performing an image processing operation on the spherical image, where the image processing operation comprises a pixel expansion processing operation on an image in the pixel expansion region, and a pixel shrinkage processing operation on an image in the pixel shrinkage region.

Abstract: This application provides a media data transmission method and apparatus. The method includes: receiving, by a client, a media presentation description (MPD) file, where the MPD file includes priority indication information, and the priority indication information is used to indicate a priority or priorities of one or more overlays; and processing, by the client, the one or more overlays based on the priority indication information.

Abstract: A client, a server, and a method for processing media data, the method including obtaining an overlay and information about a region associated with the overlay, where the information about the region associated with the overlay is used to indicate the region associated with the overlay, and displaying the overlay when a trigger operation for the region associated with the overlay is detected.