Abstract: A method for obtaining a normal vector, a geometry and a material of a three-dimensional object based on a neural network is provided. The present disclosure provides, based on an idea of “actively irradiating an object with a number of specific patterns, capturing photos at the same time, and obtaining a normal vector of an object by calculating the obtained photos”, an acquisition method combined with a neural network. Further, the method uses the obtained normal vector to optimize a model of the object. This method can also obtain material feature information while obtaining the normal vector. Finally, a high-quality geometric result and a high-quality material acquisition result are obtained jointly. The number of illumination patterns obtained by using this method is small, and the normal vector obtained by the method has high accuracy and the method is not limited to a specific acquisition device.

Abstract: A method for generating a facial animation from a single image is provided. The method is mainly divided into four steps: generation of facial feature points in an image, global two-dimensional deformation of the image, optimization of details of a facial area, and generation of texture of an oral cavity area. The present disclosure can generate a facial animation in real time according to a change of the facial feature points, and the animation quality reaches a level of current state-of-art facial image animation technology. The present disclosure can be used in a series of applications, such as facial image editing, portrait animation generation based on a single image, and facial expression editing in videos.

Abstract: The present disclosure discloses a speech-driven facial animation generation method. The method is mainly divided into six steps: extracting speech features, collecting frequency information, summarizing time information, decoding action features, driving a facial model, and sliding a signal window. The present disclosure can drive, according to an input speech audio signal, any facial model in real time under a particular delay to generate animation. The quality of the animation reaches the currently most advanced speech animation technology level, and has the characteristics of light weight and good robustness. The present disclosure can be used to generate speech animation under different scenes, such as VR virtual social networking, and virtual speech assistants and games.