Abstract: Aspects of the present disclosure provide techniques for category and joint agnostic reconstruction of articulated objects. An example method includes obtaining images of an environment having objects and generating, using a trained AI encoder, first information associated with the images based at least in part on the images, the first information comprising a plurality of joint codes and a plurality of shape codes associated with the images. The method further includes generating, using a trained AI decoder, second information associated with the objects based at least in part on the plurality of joint codes and the plurality of shape codes, the second information comprising shape information, one or more joint types, and one or more joint states corresponding to at least one of the objects. The method further includes storing the second information in memory.