Abstract: The present invention provides a panoramic video frame interpolation method, including outputting a pre-post frame image optical flow graph and a post-pre frame image optical flow graph; calculating an image optical flow graph before frame interpolation and an image optical flow graph after frame interpolation; obtaining a downsampling pre-frame image after transformation and a downsampling post-frame image after transformation; outputting a pre-post frame image correction optical flow graph, a post-pre frame image correction optical flow graph and an image occlusion relationship graph; obtaining a downsampling pre-frame image after correction and a downsampling post-frame image after correction; obtaining an upsampling image optical flow graph before frame interpolation and an upsampling image optical flow graph after frame interpolation; and calculating a frame interpolation image corresponding to a frame interpolation position.

Abstract: The present invention provides a binocular image quick processing method, including: performing feature extraction on a next-level left eye image and a next-level right eye image; acquiring a next-level image phase difference distribution estimation feature; fusing the next-level image phase difference distribution estimation feature and a next-level left eye image feature to obtain a next-level fusion feature; performing feature extraction on the next-level fusion feature to obtain a difference feature of next-level left and right eye images, and obtain an estimated phase difference of the next-level left and right eye images; acquiring an estimated phase difference of first-level left and right eye images; and performing processing operation on the corresponding images by using the estimated phase difference of the first-level left and right eye images.

Abstract: The disclosure provides a model generation method based on a multi-view panoramic image, including: calculating an image rectification rotation matrix of source images and a reference image; extracting a reference image feature of the reference image and source image features of the source images; performing a fusion operation on rectified cost volumes of the plurality of source images corresponding to the reference image to obtain a final cost volume; calculating an estimated phase difference under a set resolution; obtaining a final phase difference of the reference image; and generating a depth map of the reference image, and constructing a corresponding stereo vision model.

Abstract: Provided by the present invention is a picture focusing method, comprising: acquiring a video picture, and, according to an instruction command, determining a target object in the video picture; determining picture depth information of a video picture region in which the target object is located; acquiring parameter information of a camera corresponding to multiple video picture frames; using the picture depth information of the video picture region and the parameter information of the camera as the input of a preset focusing neural network model; and using focus adjustment information of the camera to perform a focus adjustment operation on the camera.

Abstract: The present disclosure provides a panoramic image stitching method, including the steps of acquiring a partial panoramic image taken by each lens; acquiring a first equirectangular rectangular projection graph of each partial panoramic image; performing rotation transformation on the first equirectangular rectangular projection graph of each partial panoramic image to obtain a second equirectangular rectangular projection graph; and adjusting stitching positions of adjacent second equirectangular rectangular projection graphs, and performing stitching operation on the second equirectangular rectangular projection graphs according to the adjusted stitching positions.

Abstract: The present application provides a panoramic video picture quality display method and device. Attention position information of a user at different time points in a preset period of time is obtained, the attention position information includes a picture horizontal angle; an attention information curve is created in a polar coordinate system, the attention information curve takes the time point as a polar radius and the picture horizontal angle obtained at the time point as a polar angle; and a picture quality parameter can also be obtained and the picture quality parameter is marked on the attention information curve to display the picture quality parameter.

Abstract: The present application provides a method and device for picture quality assessment after dynamic panoramic video stream cropping. An attention focus parameter is obtained, the attention focus parameter is used for representing an attention level of a user to a picture and the attention focus parameter is a function of a picture angle and a picture height; a resolution distribution parameter is obtained; the attention focus parameter and the resolution distribution parameter are combined to obtain a picture quality parameter that the user views in a dynamically cropped panoramic video stream; and the picture quality is assessed according to the picture quality parameter.

Abstract: A picture optimization method, comprising: acquiring a target picture and a plurality of corresponding reference pictures (S101); dividing the target picture into a plurality of target picture alignment regions according to a set region size, adjacent target picture alignment regions having an overlapping region (S102); acquiring, on the basis of pixel gray scales a corresponding reference picture alignment region, in each reference picture, of each target picture alignment region in the target picture, and the similarity of each target picture alignment region in the target picture with the corresponding reference picture alignment region (S103); and performing, on the basis of the similarity , superposition and fusion on the corresponding target picture alignment regions of the target picture by using reference picture alignment regions of the plurality of reference pictures, so as to perform a noise reduction operation on the target picture (S104).

Abstract: Provided by the present invention is a picture focusing method, comprising: acquiring a video picture, and, according to an instruction command, determining a target object in the video picture; determining picture depth information of a video picture region in which the target object is located; acquiring parameter information of a camera corresponding to multiple video picture frames; using the picture depth information of the video picture region and the parameter information of the camera as the input of a preset focusing neural network model; and using focus adjustment information of the camera to perform a focus adjustment operation on the camera.

Abstract: The present disclosure provides a panoramic image stitching method, including the steps of acquiring a partial panoramic image taken by each lens; acquiring a first equirectangular rectangular projection graph of each partial panoramic image; performing rotation transformation on the first equirectangular rectangular projection graph of each partial panoramic image to obtain a second equirectangular rectangular projection graph; and adjusting stitching positions of adjacent second equirectangular rectangular projection graphs, and performing stitching operation on the second equirectangular rectangular projection graphs according to the adjusted stitching positions.

Abstract: An image generation method is provided. The image generation method includes the steps of acquiring a planimetric taken input image, and segmenting the planimetric taken input image into a plurality of planimetric image regions; acquiring a region exposure time point of each planimetric image region and a lens attitude of a corresponding taking lens at the region exposure time point; correcting a planimetric position coordinate of each planimetric image region according to the lens attitude of the taking lens at the region exposure time point and a lens attitude of the taking lens at an intermediate time point of image exposure; and generating a planimetric taken output image based on the corrected planimetric position coordinates of the planimetric image regions.

Abstract: The present disclosure provides a panoramic image stitching method, including the steps of acquiring a partial panoramic image taken by each lens; acquiring a first equirectangular rectangular projection graph of each partial panoramic image; performing rotation transformation on the first equirectangular rectangular projection graph of each partial panoramic image to obtain a second equirectangular rectangular projection graph; and adjusting stitching positions of adjacent second equirectangular rectangular projection graphs, and performing stitching operation on the second equirectangular rectangular projection graphs according to the adjusted stitching positions.

Abstract: Provided is a method for playing a panoramic picture, the method comprising: acquiring a corresponding non-planar panoramic picture according to a picture acquisition instruction; acquiring picture content from the non-planar panoramic picture, and determining a main presentation axis and a presentation centre of the picture content; creating a cylindrical projection plane by using the main presentation axis and the presentation centre, wherein a cylinder extension direction of the cylindrical projection plane is substantially perpendicular to the main presentation axis, and the centre of the cylindrical projection plane essentially overlaps the presentation centre; converting the non-planar panoramic picture into a cylindrical panoramic picture with the cylindrical projection plane; and executing a playing operation on the cylindrical panoramic picture by using a planar display apparatus.

Abstract: The present application provides a method and device for picture quality assessment after dynamic panoramic video stream cropping. An attention focus parameter is obtained, the attention focus parameter is used for representing an attention level of a user to a picture and the attention focus parameter is a function of a picture angle and a picture height; a resolution distribution parameter is obtained; the attention focus parameter and the resolution distribution parameter are combined to obtain a picture quality parameter that the user views in a dynamically cropped panoramic video stream; and the picture quality is assessed according to the picture quality parameter.

Abstract: The present application provides a panoramic video picture quality display method and device. Attention position information of a user at different time points in a preset period of time is obtained, the attention position information includes a picture horizontal angle; an attention information curve is created in a polar coordinate system, the attention information curve takes the time point as a polar radius and the picture horizontal angle obtained at the time point as a polar angle; and a picture quality parameter can also be obtained and the picture quality parameter is marked on the attention information curve to display the picture quality parameter.

Abstract: The present invention provides a high dynamic range video shooting method, comprising: acquiring corresponding images by means of shooting lenses of a multi-lens panoramic camera; determining corresponding image synthesis weights of image pixel blocks according to pixel color gray scale variations, pixel color gray scale differences and pixel color gray scale offsets of the image pixel blocks of each shot image; forming a high dynamic range panoramic shot image based on the image synthesis weights of the image pixel blocks of each shot image; and splicing all the high dynamic range panoramic shot images.

Abstract: Provided in the present invention is a panoramic image acquisition device, which comprises a body, a plurality of cameras, a image extraction processor, and an image combination processor; the cameras being provided on the body at an approximate spacing between the human eyes, for acquiring partial pictures of a plurality of different shooting angles; the image extraction processor being connected to the plurality of cameras, for acquiring, on the basis of the human eyes simulating the orientations of the cameras, left-eye pictures and right-eye pictures of the partial pictures corresponding to the cameras; the image combination processor being connected to the image extraction processor, for combining the left-eye pictures of all the partial pictures into a left-eye panoramic picture and combining the right-eye pictures of all the partial pictures into a right-eye panoramic picture.

Abstract: The present invention provides a photographing synchronization method for performing a synchronous photographing operation on a plurality of cameras using any one of cameras in a multi-camera system. The method comprises: obtaining all cameras in a current synchronous network by means of network broadcast; obtaining signal transmission delays between the cameras; generating a synchronous photographing instruction of each camera according to the signal transmission delays between the cameras; and sending the synchronous photographing instructions to particular cameras over a wireless network.

Abstract: The present invention provides a high dynamic range video shooting method, comprising: acquiring corresponding images by means of shooting lenses of a multi-lens panoramic camera; determining corresponding image synthesis weights of image pixel blocks according to pixel color gray scale variations, pixel color gray scale differences and pixel color gray scale offsets of the image pixel blocks of each shot image; forming a high dynamic range panoramic shot image based on the image synthesis weights of the image pixel blocks of each shot image; and splicing all the high dynamic range panoramic shot images.