Abstract: A method, an apparatus, a medium, a terminal, and a device for processing multi-angle free-perspective data are disclosed. The method includes: acquiring a data header file; determining a defined format of a data file according to a parsing result of the data header file; reading and obtaining a data combination from the data file based on the defined format, where the data combination includes pixel data and depth data of multiple synchronized images, and the multiple synchronized images have different perspectives with respect a to-be-viewed area, and pixel data and depth data of each image of the multiple synchronized images has an association relationship; and performing image or video reconstruction of a virtual viewpoint according to the read data combination, where the virtual viewpoint is selected from a multi-angle free-perspective range, and the multi-angle free-perspective range is a range supporting virtual viewpoint switching viewing of the to-be-viewed area.

Abstract: The disclosed embodiments relate to image processing methods and apparatuses. In one embodiment, a method includes: mapping an inputted three-dimensional (3D) model map into an asymmetric cubemap, the asymmetric cubemap located at a different place than the mapping center of the inputted 3D model map; and stretching the asymmetric cubemap mapped for the inputted 3D model map into a two-dimensional (2D) stretched plane map.

Abstract: Image mapping and processing methods, apparatuses and machine-readable media are disclosed. The methods include obtaining a panoramic video image, and demarcating the panoramic video image into a primary area and at least one ancillary area; determining a primary quantization parameter corresponding to the primary area, and an ancillary quantization parameter corresponding to the ancillary area, wherein the primary quantization parameter is smaller than the ancillary quantization parameter, with the quantization parameter being inversely proportional to an image quality; and encoding the primary area based on the primary quantization parameter, encoding the ancillary area based on the ancillary quantization parameter, and determining a coded panoramic video image.

Abstract: Disclosed are video playback and data providing methods in a virtual scene, and a client and server implementing the same. The video playback method comprises: receiving current video segment data sent from a server, wherein the current video segment data represents a video segment, and the current video segment data comprises at least one specified viewing angle and a data identifier representing video segment data to which the specified viewing angle is directed; playing the video segment represented by the current video segment data, and acquiring a current viewing angle of a user during playback; and determining a target specified viewing angle matching the current viewing angle from the at least one specified viewing angle, wherein a video segment represented by video segment data to which the target specified viewing angle is directed is played at the end of the playback of the video segment represented by the current video segment data.

Abstract: Embodiments of the present application provide a method and an apparatus, and a machine readable media for image processing. The method includes obtaining a panoramic video image, where the panoramic video image is determined based on a perspective mapping, and the panoramic video image includes a primary perspective region and at least one secondary perspective region; dividing the secondary perspective region into at least two sub-regions based on distribution information of high-frequency components in the secondary perspective region; determining respective filter templates of the sub-regions, and filtering the sub-regions using the respective filter templates; and determining a filtered panoramic video image.

Abstract: Embodiments of the present application provide a method and an apparatus, and a machine readable media for image processing. The method includes obtaining a panoramic video image, where the panoramic video image is determined based on a perspective mapping, and the panoramic video image includes a primary perspective region and at least one secondary perspective region; dividing the secondary perspective region into at least two sub-regions based on distribution information of high-frequency components in the secondary perspective region; determining respective filter templates of the sub-regions, and filtering the sub-regions using the respective filter templates; and determining a filtered panoramic video image.

Abstract: Panoramic video transcoding methods, devices, and apparatuses are provided. The method involves a central processing unit (CPU) and a graphics processing unit (GPU) and includes decoding a panoramic video; mapping, at least partly using the GPU, the decoded video data to N visual angles, to obtain N channels of video data, in which N is more than 1; encoding the N channels of video data respectively to obtain N channels of video streams; and slicing and packing the N channels of video streams respectively.

Abstract: A method of estimating motion in video display data includes dividing a frame of the video display data into blocks, generating at least two motion models for a current block from motion models of neighboring blocks to the current block, and selecting one of the motion models based upon a similarity of the motion model that minimizes differences between corresponding blocks in reference frames to the current block.

Abstract: A method, a computer storage medium, and a client for switching scenes of a panoramic video are provided. The method includes playing a first primary video stream in a first video stream group associated with a first perspective of a user; determining a video stream switching time when a perspective of the user is switched from the first perspective to a second perspective, the video stream switching time being associated with a time length of a video slice in a second backup video stream; and switching from the first primary video stream to the second backup video stream when a play time of the first primary video stream reaches the video stream switching time, so that content of the second backup video stream starting from the video stream switching time is played. The present application can improve the effects of switching between scenes of the panoramic video.

Abstract: Image mapping and processing methods, apparatuses and machine-readable media are disclosed. The methods include obtaining a panoramic video image, and demarcating the panoramic video image into a primary area and at least one ancillary area; determining a primary quantization parameter corresponding to the primary area, and an ancillary quantization parameter corresponding to the ancillary area, wherein the primary quantization parameter is smaller than the ancillary quantization parameter, with the quantization parameter being inversely proportional to an image quality; and encoding the primary area based on the primary quantization parameter, encoding the ancillary area based on the ancillary quantization parameter, and determining a coded panoramic video image.

Abstract: Embodiments of the present application provide a method and an apparatus, and a machine readable media for image processing. The method includes obtaining a panoramic video image, where the panoramic video image is determined based on a perspective mapping, and the panoramic video image includes a primary perspective region and at least one secondary perspective region; dividing the secondary perspective region into at least two sub-regions based on distribution information of high-frequency components in the secondary perspective region; determining respective filter templates of the sub-regions, and filtering the sub-regions using the respective filter templates; and determining a filtered panoramic video image.

Abstract: A method of generating motion vectors for image data includes identifying boundaries of at least one object in original frames of image data, performing object motion analysis based upon the boundaries, performing pixel-level motion layer generation, using the object motion analysis and the pixel-level motion layers to generate motion for blocks in the image data, and producing block level motion information and layer information for the original frames of image data.

Abstract: To denoise video data, a temporal IIR filter is applied to video data. The temporally filtered frame is used as a guide to spatially filter the video data without introducing temporal artifacts. The spatially filtered frame can then be temporally filtered again using a temporal IIR filter. The results of the second temporal filtering can then be used as a guide to eliminate noise that the spatial filter did not eliminate.

Abstract: A method to produce a frame of video data includes receiving original frame true motion information, original frame object boundary information, and original frame layer information for at least two original frames of video data, and generating interpolation phase block-level motion and interpolation phase pixel-level layer information from the original frame block-level true motion information, original frame pixel-level object boundary information, and original frame pixel-level layer information for the original frame.

Abstract: A method of performing motion compensation includes identifying a set of candidate motion vectors for a block in an intermediate frame from a set of motion vectors from a previous and current frames, performing block-level analysis for each candidate motion vector, selecting an interpolation motion vector, and using the interpolation motion vector to interpolate the intermediate frame between the previous and current frames, wherein the number of intermediate frames depends upon a conversion to a faster frame rate. A method of determining background and foreground motion vectors for a block in an interpolated frame includes comparing a first motion vector that points to a previous frame to a second motion vector that points to a next frame to produce a difference, and designating one of the first and second motion vectors as a background motion vector and the other as a foreground motion vector depending upon the difference.

Abstract: A method of reducing artifacts in video image data includes determining pixels in a block of image data that are mosquito pixels, estimating a level of mosquito noise in the block, and filtering out the mosquito noise to produce noise-filtered data.

Abstract: An apparatus has a motion vector estimation module to perform motion vector estimation on a current frame and on a previous frame of image data to produce a current phase and a previous phase, a motion vector generation module to generate motion vector fields for the current and previous phases, and a motion vector interpolation module to find interpolated motion vectors for an interpolated phase that have minimal differences between motion vectors in the current and previous motion vector fields and to product interpolated motion vectors.

Abstract: A method of performing motion compensation includes dividing a current frame of video data into blocks, and clustering the blocks based on motion vectors.