Abstract: A method for automatically representing offline state and objects in a virtual representation. A user of this method can interact with objects in the real world in a natural way and automatically have a virtual representation of those objects updated. For example, a user may have a real toy with a virtual representation. When the user dresses the real toy with real clothes the virtual representation of the toy will automatically reflect the clothing and accessories placed on the toy. Similarly, when the user dresses in suitably adapted clothing, their own virtual representation will be automatically updated to reflect that clothing. Thus an automatic and seamless method is provided to have virtual representations of objects reflect their state in the real world.