Abstract: The present invention discloses an image interpolation method and device based on RGB-D images and a multi-camera system, wherein the method comprises performing camera calibration on each camera in the multi-camera system; clarifying a position of a new camera for interpolation according to position information of the each camera in the multi-camera system, and calculating a camera pose of the new camera according to camera calibration data; calculating a plurality of initial interpolated images that have a one-to-one correspondence with designated images captured by the each camera of the multi-camera system according to a projection relationship of the camera and the pose information of the each camera; performing image fusion on each initial interpolated image to obtain a fused interpolated image; and performing pixel completion on the fused interpolated image so as to obtain an interpolated image related to the new camera.

Abstract: The present invention discloses a method for real-time rendering of giga-pixel images. Image data are subject to offline pre-processing, and then are subject to data decoding and redirection through a decoding module. A corresponding scheduling strategy is determined according to different image inputs, and rendering is executed by a renderer. The present invention may realize the real-time rendering of a giga-pixel panoramic view in a conventional display device, to greatly reduce the resource allocated for rendering of giga-pixel images. The present invention may render an image originally requiring a 40G or more video memory capacity on a common video card with a 1G-4G video memory capacity.

Abstract: The present invention relates to an all-around spherical light field rendering method, comprising: a preparation step, i.e., preparing to input and load related files; pre-computing a latticed depth map of positions of reference cameras which are densely covered on a sphere; moving a rendering camera, enabling the moving range of the rendering camera to be the surface of the sphere, and calculating and identifying the reference cameras surrounding the rendering camera around the rendering camera; performing back projection on pixels of the rendering camera, and performing depth test with the four reference cameras; and interpolating the reference cameras passing through the depth test, thereby obtaining a finally rendered pixel value. By means of the present invention, the rendering results can be rapidly seen in real time; an object can be observed from any angle on the spherical surface, and a real immersion feeling can be felt.

Abstract: A human hairstyle generation method based on multi-feature retrieval and deformation includes: acquiring a hair style mask; identifying feature points of a human face and match the feature points with a hair style database; aligning an image with a standard human face to acquire a corresponding hair region; calculating Minkowski distances between the hair region and hair masks of all frontal faces in the hair style database; assigning corresponding weights after sorting the Minkowski distances from small to large; training a deep learning network to detect hair styles of hair basic blocks at different scales; and taking out a most similar hair style picture. The present invention utilizes a single frontal photo of the human face, and retrieves a three-dimensional hair model most similar to the photo by retrieving a database in a mass three-dimensional hair style database, to avoid manual modeling, thereby improving efficiency and ensures high fidelity.

Abstract: The present invention relates to a virtual ray tracing method and dynamic light field refocusing display system, ray information collection, or random retrieval for pixels on a full focus image, so as to reduce ray collection total; and/or simplifying cross point retrieval where an object surface is regarded smooth. The system includes a virtual reality content processor, a virtual reality monitor, an eyeball tracker, an eyeball tracing processor, and a ray refocusing processor. The present invention reduces computational complexity, enables automatic replacement of erroneous sampling, causes to achieve real and accurate refocusing. The present invention may enable dynamic refocusing along a gazing direction of the human eye, and enable focusing by a user to objects of variable distance, to be consistent with viewing characteristics of the human eye.