Abstract: An apparatus is provided. The apparatus includes a communications interface to receive raw data from an external source. The raw data includes a representation of an object. Furthermore, the apparatus includes a memory storage unit to store the raw data. The apparatus also includes a pre-processing engine to generate a coarse segmentation map and a joint heatmap from the raw data. The coarse segmentation map is to outline the object and the joint heatmap is to represent a point on the object. The apparatus further includes a neural network engine to receive the raw data, the coarse segmentation map, and the joint heatmap. The neural network engine is to generate a plurality of two-dimensional maps. Also, the apparatus includes a mesh creator engine to generate a three-dimensional mesh based on the plurality of two-dimensional maps.

Abstract: An apparatus is provided to generate mechanical index maps for mesh rigging. The apparatus includes a communications interface to receive raw data from an external source. The raw data includes a representation of an object. The apparatus further includes a memory storage unit to store the raw data. In addition, the apparatus includes a pre-processing engine to generate a segmentation map from the raw data. The segmentation map is to outline the object. Furthermore, the apparatus includes a neural network engine to generate a mechanical heatmap for a predefined key-point connector based on the segmentation map. The mechanical heatmap includes a mechanical weight index of the predefined key-point connector for each pixel.

Abstract: An apparatus is provided. The apparatus includes a communications interface to receive raw data from an external source. The raw data includes a representation of an object. Furthermore, the apparatus includes a memory storage unit to store the raw data. The apparatus also includes a pre-processing engine to generate a coarse segmentation map and a joint heatmap from the raw data. The coarse segmentation map is to outline the object and the joint heatmap is to represent a point on the object. The apparatus further includes a neural network engine to receive the raw data, the coarse segmentation map, and the joint heatmap. The neural network engine is to generate a plurality of two-dimensional maps. Also, the apparatus includes a mesh creator engine to generate a three-dimensional mesh based on the plurality of two-dimensional maps.

Abstract: An apparatus is provided an apparatus to estimate poses of multiple objects from a two-dimensional image. The apparatus includes a communications interface to receive raw data from an external source. The raw data includes a representation of a first object and a second object. In addition, the apparatus includes a memory storage unit to store the raw data. The apparatus also includes a first neural network engine to detect parts of the first object and the second object and to generate an intermediate representation of the parts. Furthermore, the apparatus includes a second neural network engine to apply a transformer neural network to the intermediate representation to parse the parts into first object parts and second object parts to generate a first pose of the first object from the first object parts and to generate a second pose of the second object from the second object parts.

Abstract: An apparatus is provided. The apparatus includes a communications interface to receive raw data from an external source. The raw data includes a representation of an object. Furthermore, the apparatus includes a memory storage unit to store the raw data. The apparatus also includes a pre-processing engine to generate a coarse segmentation map and a joint heatmap from the raw data. The coarse segmentation map is to outline the object and the joint heatmap is to represent a point on the object. The apparatus further includes a neural network engine to receive the raw data, the coarse segmentation map, and the joint heatmap. The neural network engine is to generate a plurality of two-dimensional maps. Also, the apparatus includes a mesh creator engine to generate a three-dimensional mesh based on the plurality of two-dimensional maps.

Abstract: Introduced here are computer programs that are able to generate computer vision data through local analysis of image data (also referred to as “raw data” or “input data”). The image data may be representative of one or more digital images that are generated by an image sensor. Also introduced here are apparatuses for generating and handling the image data and computer vision data.