Abstract: The present disclosure relates to a computer-implemented method of testing an autonomy stack for an autonomous vehicle in a simulated environment. The computer-implemented method comprises: receiving a scenario, a non-ego agent, and an ego agent, the scenario representing a real-world environment, wherein the ego agent is controlled by the autonomy stack; running a simulation of the scenario including the ego agent and the non-ego agent; receiving, from a user input device, a control change input; switching control of the non-ego agent between the autonomy mode and the manual mode in response to receiving the control change input; recording a sequence of events involving the ego agent to form a report; and sending a signal including the report to a report log.

Abstract: The present disclosure relates to a computer-implemented method of testing an autonomy stack for an autonomous vehicle in a simulated environment. The computer-implemented method comprises: receiving a scenario, a non-ego agent, and an ego agent, the scenario representing a real-world environment, wherein the ego agent is controlled by the autonomy stack; running a simulation of the scenario including the ego agent and the non-ego agent; receiving, from a user input device, a control change input; switching control of the non-ego agent between the autonomy mode and the manual mode in response to receiving the control change input; recording a sequence of events involving the ego agent to form a report; and sending a signal including the report to a report log.

Abstract: The present invention relates to a computer-implemented method of comparing an autonomy stack with an updated autonomy stack in a simulator. The computer-implemented method comprising: retrieving a portion of telemetry data recorded by the autonomy stack, the telemetry data representing a real-world environment in which an autonomous vehicle operated, the autonomous vehicle controlled by the autonomy stack; generating a simulation of the real-world environment using the telemetry data; providing an ego-vehicle in the simulation at a position of the autonomous vehicle associated with the telemetry data, the ego-vehicle controlled in the simulation by the autonomy stack; providing an updated ego-vehicle in the simulation, the updated ego-vehicle controlled in the simulation by the updated autonomy stack; generating a real-time simulation by positionally synchronising the ego-vehicle with the updated ego-vehicle; and displaying the real-time simulation on a display device.