Abstract: A virtual representation of a physical environment can be generated through simulation, which can include one or more virtual agents to represent robots, or at least semi-automated devices, that can operate and perform various tasks in the physical environment. Various component failures, or other potential problems, can be simulated that can be analyzed by one or more deep learning models associated with the virtual agents. These deep learning models can attempt to diagnose the simulated problem, as well as determine one or more potential solutions. The virtual agents can help to gather information for these determinations, as well as to perform tasks for these potential solutions. Once these deep learning models are trained in this simulated environment, these models can be used by one or more robots to perform tasks that may relate to maintenance or operation of a physical environment.