Abstract: A virtual facility system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store data including video of the real facility. The data engine may train a neural rendering model of the real facility based on the data providing a photorealistic three-dimensional representation of the real facility. The integration system may provide one or more interfaces facilitating communication with one or more control systems associated with the real facility including a management system providing historical or live inventory tracking data and facility operations process data characterizing of locations and tasks corresponding with inventory items or materials stored or handled in the real facility. The virtual facility interface system may provide access to information stored in a virtual facility. The simulator engine may simulate novel views generated based on the neural rendering model.

Abstract: A virtual facility robotics system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store video data of a real facility. The data engine may train a neural rendering model providing a photorealistic three-dimensional representation of the real facility. The integration system may provide facilitate communication with a robot fleet manager configured to control one or more robots operating within the real facility. The virtual facility interface system may provide access to information stored in a virtual facility that includes the photorealistic three-dimensional representation of the real facility. The virtual facility interface system may be configured to provide information to the robot fleet manager via the integration system upon request. The simulator engine may simulate a future state of the real facility including one or more novel views generated based on the neural rendering model.