Abstract: A virtual facility system may include a storage system storing video data collected from real facilities. A data engine may be configured to train a neural rendering model based on the data. The neural rendering model may be incorporated into virtual facilities corresponding to the real facilities. The virtual facilities may provide photorealistic three-dimensional representations of the real facilities. An integration system may provide interfaces facilitating communication with one or more control systems associated with the real facilities. A virtual facility interface system may be configured to generate a novel virtual facility using the neural rendering model based on configuration parameters specifying characteristics of the novel virtual facility. A simulator engine may generate novel views of a simulated future state of the virtual facility based on the neural rendering model.

Abstract: A virtual facility system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store data including video of the real facility. The data engine may train a neural rendering model of the real facility based on the data providing a photorealistic three-dimensional representation of the real facility. The integration system may provide one or more interfaces facilitating communication with one or more control systems associated with the real facility including a management system providing historical or live inventory tracking data and facility operations process data characterizing of locations and tasks corresponding with inventory items or materials stored or handled in the real facility. The virtual facility interface system may provide access to information stored in a virtual facility. The simulator engine may simulate novel views generated based on the neural rendering model.

Abstract: A robot may identify a human located proximate to the robot in a physical environment based on sensor data captured from one or more sensors on the robot. A trajectory of the human through space may be predicted. When the predicted trajectory of the human intersects with a current path of the robot, an updated path to a destination location in the environment may be determined so as to avoid a collision between the robot and the human along the predicted trajectory. The robot may then move along the determined path.

Abstract: A virtual facility robotics system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store video data of a real facility. The data engine may train a neural rendering model providing a photorealistic three-dimensional representation of the real facility. The integration system may provide facilitate communication with a robot fleet manager configured to control one or more robots operating within the real facility. The virtual facility interface system may provide access to information stored in a virtual facility that includes the photorealistic three-dimensional representation of the real facility. The virtual facility interface system may be configured to provide information to the robot fleet manager via the integration system upon request. The simulator engine may simulate a future state of the real facility including one or more novel views generated based on the neural rendering model.

Abstract: A virtual facility system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store data including video of the real facility. The data engine may train a neural rendering model of the real facility based on the data providing a photorealistic three-dimensional representation of the real facility. The integration system may provide one or more interfaces facilitating communication with one or more control systems associated with the real facility including a management system providing historical or live inventory tracking data and facility operations process data characterizing of locations and tasks corresponding with inventory items or materials stored or handled in the real facility. The virtual facility interface system may provide access to information stored in a virtual facility. The simulator engine may simulate novel views generated based on the neural rendering model.

Abstract: A virtual facility system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store data including video of the real facility. The data engine may train a neural rendering model of the real facility based on the data providing a photorealistic three-dimensional representation of the real facility. The integration system may provide one or more interfaces facilitating communication with one or more control systems associated with the real facility including a management system providing historical or live inventory tracking data and facility operations process data characterizing of locations and tasks corresponding with inventory items or materials stored or handled in the real facility. The virtual facility interface system may provide access to information stored in a virtual facility. The simulator engine may simulate novel views generated based on the neural rendering model.

Abstract: A virtual facility robotics system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store video data of a real facility. The data engine may train a neural rendering model providing a photorealistic three-dimensional representation of the real facility. The integration system may provide facilitate communication with a robot fleet manager configured to control one or more robots operating within the real facility. The virtual facility interface system may provide access to information stored in a virtual facility that includes the photorealistic three-dimensional representation of the real facility. The virtual facility interface system may be configured to provide information to the robot fleet manager via the integration system upon request. The simulator engine may simulate a future state of the real facility including one or more novel views generated based on the neural rendering model.

Abstract: A cleaning robot may determine a three-dimensional model of a physical environment based on data collected from one or more sensors. The cleaning robot may then identify a surface within the physical environment to clean. Having identified that surface, the robot may autonomously navigate to a location proximate to the surface, position an ultraviolet light source in proximity to the surface, and activate the ultraviolet light source for a period of time.

Abstract: A model of a physical environment may be determined based at least in part on sensor data collected by one or more sensors at a robot. The model may include a plurality of constraints and a plurality of data values. A trajectory through the physical environment may be determined for an ultraviolet end effector coupled with the robot to clean one or more surfaces in the physical environment. The ultraviolet end effector may include one or more ultraviolet light sources. The ultraviolet end effector may be moved along the trajectory.

Abstract: A model of a physical environment may be determined based at least in part on sensor data collected by one or more sensors at a robot. The model may include a plurality of constraints and a plurality of data values. A trajectory through the physical environment may be determined for an ultraviolet end effector coupled with the robot to clean one or more surfaces in the physical environment. The ultraviolet end effector may include one or more ultraviolet light sources. The ultraviolet end effector may be moved along the trajectory.

Abstract: A cleaning robot may determine a three-dimensional model of a physical environment based on data collected from one or more sensors. The cleaning robot may then identify a surface within the physical environment to clean. Having identified that surface, the robot may autonomously navigate to a location proximate to the surface, position an ultraviolet light source in proximity to the surface, and activate the ultraviolet light source for a period of time.

Abstract: A robot may identify a human located proximate to the robot in a physical environment based on sensor data captured from one or more sensors on the robot. A trajectory of the human through space may be predicted. When the predicted trajectory of the human intersects with a current path of the robot, an updated path to a destination location in the environment may be determined so as to avoid a collision between the robot and the human along the predicted trajectory. The robot may then move along the determined path.