Abstract: Aspects of the disclosure provide methods and apparatuses for point cloud processing. In some examples, an apparatus for point cloud processing includes processing circuitry. For example, the processing circuitry obtains point cloud data corresponding to a point cloud in a three dimensional (3D) space, projects the point cloud in the 3D space to one or more two dimensional (2D) planes to generate one or more images. The processing circuitry generates a pixel wise mask for object instances in the point cloud according to the one or more images. The pixel wise mask includes first pixels that are associated with a first object instance in the point cloud. The processing circuitry processes the point cloud based on the pixel wise mask, a portion of the point cloud corresponding the first pixels in the pixel wise mask is processed based on one or more processing parameters determined for the first object instance.

Abstract: A method and apparatus that renders a mesh from one or more virtual camera views of an object, the one or more virtual camera views being projections of the mesh onto a plurality of 2D planes; inputs the one or more virtual camera views into a fully-convolutional model for real-time segmentation; generates one or more 2D pixel-wise masks based on the fully-convolutional model, the 2D pixel-wise masks being associated with one or more segmented elements; performs remeshing and mesh optimization using the one or more 2D pixel-wise masks; and generates an output mesh based on the remeshing and mesh optimization.

Abstract: Aspects of the disclosure provide methods and apparatuses for gaze matching. In some examples, processing circuitry determines a position of an object of interest for a first user, and receives first one or more images of the first user that is taken by a camera at a camera position different from the position of the object of interest. The processing circuitry detects a first vergence of eyes of the first user, calculates a mismatch of the first vergence for viewing the object of interest, and performs a gaze correction of the first one or more images based on the mismatch of the first vergence for viewing the object of interest.