Abstract: Systems and method are provided for a driving run performed by a sensor-equipped robot in a driving scene comprising at least one dynamic signalling agent (DSA). DSA data indicating, signalling states of the at least one DSA as a function of time is received, and a graphical user interface (GUI), comprising a schematic representation of the run and at least one DSA state timeline showing a visual indicator of the current signalling state of a corresponding one of the at least one DSA, is rendered on the GUI.

Abstract: A computer system for rendering a graphical user interface for visualising runs of a driving scenario in which an ego agent navigates a road layout, comprising an input configured to receive a map of the road layout and run data comprising a sequence of timestamped ego agent states and a time-varying numerical score quantifying the performance of the ego agent with respect a set of run evaluation rules; and a rendering component configured to cause a graphical user interface to display, for each rule: a plot of the time-varying numerical score, and a marker denoting a selected time index of the plot, the marker movable along the time axis to change the selected time index; and a scenario visualization comprising a visualization of the run at the selected time index, whereby moving the marker along the time axis causes the scenario visualisation to update as the time index is changed.

Abstract: A computer system for rendering a graphical user interface for visualising runs of a driving scenario in which an ego agent navigates a road layout, comprising an input configured to receive a map of the road layout and run data comprising a sequence of timestamped ego agent states and a time-varying numerical score quantifying the performance of the ego agent with respect a set of run evaluation rules; and a rendering component configured to cause a graphical user interface to display, for each rule: a plot of the time-varying numerical score, and a marker denoting a selected time index of the plot, the marker movable along the time axis to change the selected time index; and a scenario visualization comprising a visualization of the run at the selected time index, whereby moving the marker along the time axis causes the scenario visualisation to update as the time index is changed.

Abstract: A computer-implemented method for assessing autonomous vehicle performance comprising receiving, at an input, performance data of at least one autonomous driving run, the performance data comprising at least one time series of perception errors and at least one time series of driving performance results; and generating, at a rendering component, rendering data for rendering a graphical user interface, the graphical user interface for visualizing the performance data and comprising: a perception error timeline, and a driving assessment timeline, wherein the timelines are aligned in time, and divided into multiple time steps of the at least one driving run, wherein, for each time step: the perception timeline comprises a visual indication of whether a perception error occurred at that time step, and the driving assessment timeline comprises a visual indication of driving performance at that time step.