Abstract: A method, apparatus, and system for generating tight two-dimensional (2D) bounding boxes for visible objects in a three-dimensional (3D) scene is disclosed. A two-dimensional (2D) segmentation image of a three-dimensional (3D) scene comprising one or more objects is generated by rendering the 3D scene with a segmentation camera. Each of the objects is rendered in a single respective different color. Next, one or more visible objects in the 3D scene are identified among the one or more objects based on the segmentation image. Next, a 2D amodal segmentation image for each of the visible objects in the 3D scene is generated separately. Each amodal segmentation image comprises only the single visible object for which it is generated. Thereafter, a 2D bounding box is generated for each of the visible objects in the 3D scene based on the amodal segmentation image for the visible object.

Abstract: In one embodiment, a method may obtain, from an application, (a) an image and (b) a layer frame having a first pose in front of the image. The method may generate, for a first viewpoint associated with a first time, a first display frame by separately rendering the image and the layer frame having the first pose into a display buffer. The method may display the first display frame at the first time. The method may determine an extrapolated pose for the layer frame based on the first pose of the layer frame and a second pose of a previously submitted layer frame. The method may generate, for a second viewpoint associated with a second time, a second display frame by separately rendering the image and the layer frame having the extrapolated pose into the display buffer. The method may display the second display frame at the second time.

Abstract: A method, apparatus, and system for generating a target distorted image from a synthetic distortion-less source cubemap image is disclosed. A synthetic distortion-less source cubemap image is generated. For each pixel on a target distorted image, a pixel on the source cubemap image that corresponds to the pixel on the target distorted image is determined. For each pixel on the target distorted image, a color of the corresponding pixel on the source cubemap image is determined. Thereafter, a same color as the determined color of the corresponding pixel on the source cubemap image is filled in at each pixel on the target distorted image.

Abstract: A method, apparatus, and system for generating a target distorted image from a synthetic distortion-less source cubemap image is disclosed. A synthetic distortion-less source cubemap image is generated. For each pixel on a target distorted image, a pixel on the source cubemap image that corresponds to the pixel on the target distorted image is determined. For each pixel on the target distorted image, a color of the corresponding pixel on the source cubemap image is determined. Thereafter, a same color as the determined color of the corresponding pixel on the source cubemap image is filled in at each pixel on the target distorted image.

Abstract: A method, apparatus, and system for generating tight two-dimensional (2D) bounding boxes for visible objects in a three-dimensional (3D) scene is disclosed. A two-dimensional (2D) segmentation image of a three-dimensional (3D) scene comprising one or more objects is generated by rendering the 3D scene with a segmentation camera. Each of the objects is rendered in a single respective different color. Next, one or more visible objects in the 3D scene are identified among the one or more objects based on the segmentation image. Next, a 2D amodal segmentation image for each of the visible objects in the 3D scene is generated separately. Each amodal segmentation image comprises only the single visible object for which it is generated. Thereafter, a 2D bounding box is generated for each of the visible objects in the 3D scene based on the amodal segmentation image for the visible object.

Abstract: An apparatus and method are provided for rotating 3D objects on a mobile device screen. A first finger touch is detected on a touch screen of a mobile electronic device and the presence of a second finger is detected on a second sensor of the device. The second sensor is a different sensor than the touch screen. A motion of the first finger is detected while the second finger is present on the second sensor. In response, a 3D object displayed on a screen of the mobile electronic device is rotated by an amount related to the motion of the first finger. Simultaneous motion of the first and second fingers may be detected, and the 3D object rotated by an amount related to both finger motions.

Abstract: An apparatus and method are provided for rotating 3D objects on a mobile device screen. A first finger touch is detected on a touch screen of a mobile electronic device and the presence of a second finger is detected on a second sensor of the device. The second sensor is a different sensor than the touch screen. A motion of the first finger is detected while the second finger is present on the second sensor. In response, a 3D object displayed on a screen of the mobile electronic device is rotated by an amount related to the motion of the first finger. Simultaneous motion of the first and second fingers may be detected, and the 3D object rotated by an amount related to both finger motions.

Abstract: A method for shape compression and physics processing is provided. One embodiment includes providing a volume model including a shape with one or more complex portions. The volume model is preprocessed based on: processing a surface of the volume model for obtaining a global structure, and mapping surface elements to a cube surface. The global structure and a result of the mapping is synchronized between a first electronic device and a second electronic device. The second electronic device performs shape modeling using the global structure and the result of the mapping, physics computing for shape deformation based on the shape modeling, and coding deformed shape features for generating surface shape characteristic elements.

Abstract: A method for shape compression and physics processing is provided. One embodiment includes providing a volume model including a shape with one or more complex portions. The volume model is preprocessed based on: processing a surface of the volume model for obtaining a global structure, and mapping surface elements to a cube surface. The global structure and a result of the mapping is synchronized between a first electronic device and a second electronic device. The second electronic device performs shape modeling using the global structure and the result of the mapping, physics computing for shape deformation based on the shape modeling, and coding deformed shape features for generating surface shape characteristic elements.