Abstract: A concurrent simulation of multiple sensor modalities includes identifying the multiple sensor modalities in association with a simulation scenario, determining a timeline interleaving a publishing or operating frequency of each of the multiple sensor modalities relative to each other, determining a current time interval of a sliding window in the timeline, determining a simulation segment of the simulation scenario using the current time interval of the sliding window, rendering a scene based on the simulation segment, executing a simulation to concurrently simulate the multiple sensor modalities using ray tracing in the rendered scene, and generating simulated sensor data of the multiple sensor modalities based on executing the simulation.