Abstract: Systems and methods for generating a synthetic video based on an audio are provided. An exemplary system may include a memory storing computer-readable instructions and at least one processor. The processor may execute the computer-readable instructions to perform operations. The operations may include receiving a reference video including a motion picture of a human face and receiving the audio including a speech. The operations may also include generating a synthetic motion picture of the human face based on the reference video and the audio. The synthetic motion picture of the human face may include a motion of a mouth of the human face presenting the speech. The motion of the mouth may match a content of the speech. The operations may further include generating the synthetic video based on the synthetic motion picture of the human face.

Abstract: A modeling method and apparatus based on point cloud data, an electronic device, and a storage medium are provided, and relate to the field of three-dimensional panoramic technologies. The modeling method based on point cloud data includes: obtaining three-dimensional point cloud information collected by a point cloud collection device from a scanned target, a first time information, first rotation position information of an electric motor, and a second time information; determining second rotation position information based on the first time information and the second time information; and obtaining position information of the scanned target based on the three-dimensional point cloud information and the second rotation position information, to construct a three-dimensional panoramic model corresponding to the scanned target.

Abstract: A method for video processing is provided. The method comprises obtaining an image of a scene, obtaining a video that records an area included in the scene, determining one or more frames from the plurality of frames of the video, determining pairs of matched features, generating a plurality of composite frames by combining each of the selected one or more frames with the image of the scene based on the pairs of matched features, and generating a composite video based on the plurality of composite frames. Each of the pairs of matched features is related to an object that is in both the image and the one or more frames. Each of the pairs of matched features is associated with one or more pixels of the image of the scene and one or more pixels of a selected frame of the one or more frames.

Abstract: A three-dimensional imaging apparatus includes: a housing having a first opening and a second opening; a first imaging device configured to collect a first set of image data, the first imaging device being mounted within the housing and having an optical axis through the first opening of the housing and a first field of view configured with respect to the optical axis; and a second imaging device configured to collect a second set of image data, the second imaging device being mounted within the housing and having a scanning plane through the second opening of the housing and a second field of view configured with respect to the scanning plane. The optical axis of the first imaging device and the scanning plane of the second imaging device form an angle. The first field of view and the second field of view do not overlap.

Abstract: A method for navigating in a simulated environment is disclosed herein. A navigation device determines a search space associated with a plurality of viewpoints other than the current viewpoint in a three-dimensional (3D) space for a current viewpoint. The search space comprises a set of 3D coordinates for each of the plurality of viewpoints. The navigation device determines a field of view at the current viewpoint, which is an area associated with a viewing angle and a visible distance. The navigation device determines a target viewpoint in the search space of the current viewpoint based on the field of view at the current viewpoint. The target viewpoint is outside the area of the field of view at the current viewpoint. The navigation device causes display of a guidance user interface (UI) comprising an indicator corresponding to the target viewpoint in the field of view at the current viewpoint.

Abstract: A method for generating an image of a scene with a corresponding depth map is disclosed herein. The method comprises collecting a plurality of copies of a two-dimensional image of the scene, generating an intermediate image by concatenating the plurality of copies of the two-dimensional image along a first direction, generating an intermediate depth map corresponding to the intermediate image by applying a neural network to the intermediate image, and generating, from the intermediate image and the intermediate depth map, the image of the scene with the corresponding depth map.

Abstract: Embodiments of the present disclosure disclose a method and device for vertical correction of a panoramic image, an electronic apparatus and a storage medium. The method includes extracting a set of straight line segments from the panoramic image, where an included angle between each straight line segment in the set of straight line segments and a current vertical direction of the panoramic image is less than a preset angle. The method further includes determining a set of target points by mapping the set of straight line segments on a unit sphere of the panoramic image. The method also includes determining an equatorial plane based on the set of target points and the center of the unit sphere and determining a vertical correction matrix based on the equatorial plane and a unit vector of the current vertical direction. The method additionally includes performing the vertical correction on the panoramic image using the vertical correction matrix.

Abstract: Systems and methods are provided for providing an audio-guided in-door virtual reality (VR) tour. An exemplary system may include a communication interface configured to receive input from a user and to output media contents, a memory storing computer-readable instructions, and at least one processor coupled to the communication interface and the memory. The computer-readable instructions, when executed by the processor, may cause the at least one processor to perform operations. The operations may include displaying a view of a 3D VR environment and playing an audio guide associated with the view. The operations may also include detecting, during the playing of the audio guide, a target operation input by the user to alter the view. In response to the detection of the target operation, the operations may include adjusting, based on the detected target operation, the view with respect to a fixed point position within the 3D VR environment.

Abstract: A method for capturing an image of a scene using an imaging device is disclosed herein. The method includes determining a coordinate system with an origin based on an initial position of the imaging device, generating a first condition to control the position of the imaging device in the coordinated system with respect to the origin, generating a second condition to control the orientation of the imaging device, determining a position and an orientation of the imaging device, generating a first prompt message in response to the position of the imaging device satisfying the first condition, and generating a second prompt message in response to the orientation of the imaging device satisfying the second condition.

Abstract: A method for combining multiple images is disclosed herein. A target mapping matrix is determined based on a first image and a second image. The target mapping matrix is associated with a target correspondence between the first image and the second image. The first image and the second image are combined into a combined image based on the first target mapping matrix. The combined image is output by implementing the disclosed method.

Abstract: Systems and methods for constructing a panoramic view based on a changing viewpoint are disclosed. An exemplary system includes a storage device configured to receive first image data of a scene for a first viewpoint at a first predetermined elevation. The system further includes at least one processor configured to convert the first image data to candidate image data for at one or more second predetermined elevations using a deep learning neural network. The at least one processor is further configured to receive a user view request for virtually viewing the scene and determine second image data for a second viewpoint associated with the user view request, by mapping the second viewpoint to the one or more second predetermined elevations. The at least one processor is also configured to render the three-dimensional model of the scene based on the second image data and display the panoramic view in response to the user view request.

Abstract: An information playback method and device, a computer readable storage medium, and an electronic device, relating to the technical field of computers. Said method comprises: performing identification on a spatial image in a 3D model and obtaining an information display device and a display area in the spatial image (201); determining the display position information corresponding to the display area (202); overlaying an information playback layer in the display area according to the display position information so as to play back display information in the information playback layer (203). By overlaying an information playback layer on the information display device in a 3D model, further information exchange can be implemented in the 3D model, so that user can experience a more reality-like scenario in the 3D model, thereby enhancing user experience.

Abstract: A method for generating a panoramic image is disclosed. The method includes receiving a three-dimensional model of a target space and an initial panoramic image of the target space, the initial panoramic image having a latitude span less than a preset latitude span; determining a first set of coordinate parameters of a camera associated with the initial panoramic image and with respect to a reference frame associated with the three-dimensional model; mapping, based on the first set of coordinate parameters of the camera, data points of the three-dimensional model to a camera coordinate system associated with the camera to obtain an intermediate panoramic image; and obtaining a final panoramic image by merging the initial panoramic image and the intermediate panoramic image, the final panoramic image having a latitude span greater than or equal to the preset latitude span.

Abstract: Systems and methods for generating a synthetic video based on an audio are provided. An exemplary system may include a memory storing computer-readable instructions and at least one processor. The processor may execute the computer-readable instructions to perform operations. The operations may include receiving a reference video including a motion picture of a human face and receiving the audio including a speech. The operations may also include generating a synthetic motion picture of the human face based on the reference video and the audio. The synthetic motion picture of the human face may include a motion of a mouth of the human face presenting the speech. The motion of the mouth may match a content of the speech. The operations may further include generating the synthetic video based on the synthetic motion picture of the human face.

Abstract: A method for navigating in a simulated environment is disclosed herein. A navigation device determines a search space associated with a plurality of viewpoints other than the current viewpoint in a three-dimensional (3D) space for a current viewpoint. The search space comprises a set of 3D coordinates for each of the plurality of viewpoints. The set of 3D coordinates indicates a position of the corresponding viewpoint in the 3D space. The navigation device determines a field of view at the current viewpoint. The field of view is associated with a viewing angle and a visible distance. The navigation device determines a target viewpoint in the search space of the current viewpoint based on the field of view at the current viewpoint. The navigation device causes display of a guidance user interface (UI) comprising an indicator corresponding to the target viewpoint in the field of view at the current viewpoint.

Abstract: A modeling method and apparatus based on point cloud data, an electronic device, and a storage medium are provided, and relate to the field of three-dimensional panoramic technologies. The modeling method based on point cloud data includes: obtaining three-dimensional point cloud information collected by a point cloud collection device from a scanned target, a first time information, first rotation position information of an electric motor, and a second time information; determining second rotation position information based on the first time information and the second time information; and obtaining position information of the scanned target based on the three-dimensional point cloud information and the second rotation position information, to construct a three-dimensional panoramic model corresponding to the scanned target.

Abstract: Systems and methods for constructing a three-dimensional panorama model of an object are disclosed. An exemplary system includes a storage device configured to receive a plurality of point clouds each acquired at a different view angle. Each point cloud includes three-dimensional positions of a plurality of target points on a surface of the object. The system further includes at least one processor configured to determine elevation and normal at each target point in each point cloud and convert the elevation of each target point to color information. The at least one processor is further configured to register every two adjacent point clouds among the plurality of point clouds based on the three-dimensional positions, the normal, and the color information of the respective target points of the two adjacent point clouds. The at least one processor is also configured to render the three-dimensional panorama model based on the registered point clouds.