Abstract: A computer-implemented method of evaluating the performance of a trajectory planner for a mobile robot in a real or simulated scenario, comprises receiving scenario ground truth of the scenario, the scenario ground truth generated using the trajectory planner to control an ego agent of the scenario responsive to at least one scenario element of the scenario. One or more performance evaluation rules for the scenario and at least one activation condition for each performance evaluation rule are received. A test oracle processes the scenario ground truth to determine whether the activation condition of each performance evaluation rule is satisfied over multiple time steps of the scenario. Each performance evaluation rule is evaluated by the test oracle, to provide at least one test result, only when its activation condition is satisfied.

Abstract: A computer implemented method of training an encoder to extract features from sensor data comprises generating a plurality of training examples, each training example comprising at least two data representations of a set of sensor data, the at least two data representations related by a transformation parameterized by at least one numerical transformation value; and training the encoder based on a self-supervised regression loss function applied to the training examples. The encoder extracts respective features from the at least two data representations of each training example, and at least one numerical output value is computed from the extracted features. The self-supervised regression loss function encourages the at least one numerical output value to match the at least one numerical transformation value parameterizing the transformation.

Abstract: A method of predicting actions of one or more actor agent in a scenario is implemented by an ego agent in the scenario. A plurality of agent models are used to generate a set of candidate futures, each candidate future providing an expected action of the actor agent. A weighting function is applied to each candidate future to indicate its relevance in the scenario. A group of candidate futures is selected for each actor agent based on the indicated relevance, wherein the plurality of agent models comprises a first model representing a rational goal directed behaviour inferable from the vehicular scene, and at least one second model representing an alternate behaviour not inferable from the vehicular scene.

Abstract: An imaging system for an autonomous vehicle comprises a camera for capturing images within a first field of view, a transparent disc arranged in front of the camera such that the transparent disc covers the field of view of the camera, an actuator configured to rotate the transparent disc, and a mounting arrangement configured to mount the camera, the transparent disc and the actuator on an autonomous vehicle. Also described is an imaging system comprises a camera for capturing images within a first field of view through a transparent surface, and a fluid dispenser constructed and arranged to spray a fluid onto the transparent surface within the first field of view. Also described is an image capture system for an autonomous vehicle comprising two such cameras with respective transparent discs and actuators.

Abstract: A method of assessing lateral stability of a moving vehicle in a real or simulated driving scenario comprises: determining a time-varying lateral position signal for the moving vehicle; computing an evolving frequency spectrum of the time-varying lateral position signal over a moving window across the time-varying lateral position signal; and analysing the evolving frequency spectrum to extract a lateral stability signal that indicates an extent to which the moving vehicle is maintaining a stable lateral position.

Abstract: A computer-implemented method of computer-implemented method of perceiving structure in a point cloud comprises: applying clustering to the point cloud, and thereby identifying at least one moving object cluster within the point cloud, the point cloud comprising time-stamped points captured over a non-zero accumulation window; determining a motion model for the moving object cluster, by fitting one or more parameters of the motion model to the time-stamped points of that cluster; using the motion model to transform the time-stamped points of the moving object cluster to a common reference time; and applying a perception component to the transformed points of the moving object cluster to extract information about structure exhibited in the transformed points.

Abstract: A method of annotating road images, the method comprising implementing, at an image processing system, the following steps: receiving a time sequence of two dimensional images as captured by an image capture device of travelling vehicle; processing the images to reconstruct, in three-dimensional space, a path travelled by the vehicle; using the reconstructed vehicle path to determine expected road structure extending along the reconstructed vehicle path; and generating road annotation data for marking at least one of the images with an expected road structure location, by performing a geometric projection of the expected road structure in three-dimensional space onto a two-dimensional plane of that image.

Abstract: An autonomous vehicle (AV) planning method comprises: receiving sensor inputs pertaining to an AV; processing the AV sensor inputs to determine an encountered driving scenario; in an AV planner, executing a tree search algorithm to determine a sequence of AV manoeuvres corresponding to a path through a constructed game tree; and generating AV control signals for executing the determined sequence of AV manoeuvres; wherein the game tree has a plurality of nodes representing anticipated states of the encountered driving scenario, and the anticipated driving scenario state of each child node is determined by updating the driving scenario state of its parent node based on (i) a candidate AV manoeuvre and (ii) an anticipated behaviour of at least one external agent in the encountered driving scenario.

Abstract: A computer system receives scenario data generated using a trajectory planner to control an ego agent responsive to at least one other agent in a real or simulated scenario. A test oracle provides predetermined extractor functions for extracting time-varying numerical signals from the scenario data and predetermined assessor functions for assessing the extracted time-varying signals. The test oracle applies, to the scenario data, a rule graph comprising extractor nodes and assessor nodes. Each extractor node applies one of the predetermined extractor functions to the scenario data to extract an output in the form of a time-varying numerical signal. Each assessor node has one or more child nodes, each child node being one of the extractor nodes or another of the assessor nodes, and the assessor node applies one of the predetermined assessor functions to the output(s) of its child node(s).

Abstract: A computer-implemented method of modelling a perception system for perceiving objects captured in sensor data comprises: receiving a plurality of training examples, each comprising a ground truth scene for a set of sensor data and a corresponding perceived scene obtained by applying the perception system to the set of sensor data; fitting to the training examples noise model parameters, encoding a noise distribution over perceived scenes given a misdetection scene, and misdetection model parameters, encoding a misdetection distribution over misdetection scenes given a ground truth scene; computing a perception distribution over perceived scenes for a given ground truth scene by marginalizing the product of noise and misdetection distributions over multiple misdetection scenes, wherein individual objects in the ground truth scene are not associated with individual objects in the perceived scenes; fitting the noise and misdetection model parameters to match the perception distribution to the perceived scene for

Abstract: A computer-implemented method of processing images for extracting information about known objects comprises the steps of receiving an image containing a view of a known object at a scale dependent on an object distance of the known object from an image capture location of the image; determining, from a world model representing one or more known objects in the vicinity of the image capture location, an object location of the known object, the object location and the image capture location defined in a world frame of reference; and based on the image capture location and the object location in the world frame of reference, applying image scaling to the image, to extract a rescaled image containing a rescaled view of the known object at a scale that is substantially independent of the object distance from the image capture location.

Abstract: A computer implemented method of path verification in a computer system is described. A user provides input to mark a displayed image of a scenario. A path is generated representing the trajectory of a vehicle. Control points along the path are recorded, each control point associated with a vehicle position and target speed. A vehicle position end target speed of two control points is used to calculate at least one path verification parameter which defines how a vehicle travelling along the path would behave. The at least one verification parameter is compared with a corresponding threshold value; and an alert is generated to the user at the user interface when the at least one path verification parameter exceeds the corresponding threshold value.

Abstract: The invention provides a computer-implemented method of planning a path for a mobile robot such as an autonomous vehicle in the presence of K obstacles. The method uses, for each of the K obstacles, a shape Bk and a density function pk(x) representing the probabilistic position of the obstacle. The method repeats the following steps for at least two different paths A: —choosing a path A, where A is the swept area of the robot within a given time interval; and—calculating based on the density function of each obstacle and the swept path an upper bound on the total probability of at least one collision FD between the robot and the K obstacles. This allows a number of candidate paths to be ranked for safety. By precomputing factors of the computational steps over K obstacles, the computation per path is O(N), and not O(NK). A safety threshold can be used to filter out paths below that threshold.

Abstract: Abstract: A driving scenario is extracted from real-world driving data captured within a road layout. A simulation is run based on the extracted driving scenario, in which an ego agent and a simulated non-ego agent each exhibit closed-loop behaviour. The closed-loop behaviour of the ego agent is determined by autonomous decisions taken in an AV stack under testing in response to simulated inputs, reactive to the simulated agent. The closed-loop behaviour of the non-ego agent is determined by implementing an inferred goal or behaviour, reactive to the ego agent. The goal or behaviour is inferred from an observed trace of a real-world agent extracted from the real-world driving data.

Abstract: A computer system for analysing driving scenes in relation to an autonomous vehicle (AV) operational design domain (ODD), the computer system comprising: an input configured to receive a definition of the ODD in a formal ontology language; a scene processor configured to receive data of a driving scene and extract a scene representation therefrom, the data comprising an ego trace, at least one agent trace, and environmental data about an environment in which the traces were captured or generated, wherein the scene representation is an ontological representation of both static and dynamic elements of the driving scene extracted from the traces and the environmental data, and expressed in the same formal ontology language as the ODD; and a scene analyzer configured to match the static and dynamic elements of the scene representation with corresponding elements of the ODD, and thereby determine whether or not the driving scene is within the defined ODD.

Abstract: A computer implemented method of generating a scenario to be run in a simulation environment for testing the behaviour of an autonomous vehicle is described. An image is rendered on a display. A user can mark multiple locations to create at least one path for an agent vehicle in the rendered image. A path is generated which passes through the locations and rendered on the display. A user can define at least one behavioural parameter for controlling behaviour of the agent vehicle associated with the at least one path when the scenario is run in a simulation environment. The scenario is recorded for future use.

Abstract: In one aspect, hierarchical image segmentation is applied to an image formed of a plurality of pixels, by classifying the pixels according to a hierarchical classification scheme, in which at least some of those pixels are classified by a parent level classifier in relation to a set of parent classes, each of which is associated with a subset of child classes, and each of those pixels is also classified by at least one child level classifier in relation to one of the subsets of child classes, wherein each of the parent classes corresponds to a category of visible structure, and each of the subset of child classes associated with it corresponds to a different type of visible structure within that category.

Abstract: A computer-implemented method of evaluating the performance of a full or partial autonomous vehicle (AV) stack in simulation, the method comprising: applying an optimization algorithm to a numerical performance function defined over a scenario space, wherein the numerical performance function quantifies the extent of success or failure of the AV stack as a numerical score, and the optimization algorithm searches the scenario space for a driving scenario in which the extent of failure of the AV stack is substantially maximized, wherein the optimization algorithm evaluates multiple driving scenarios in the search space over multiple iterations, by running a simulation of each driving scenario in a simulator, in order to provide perception inputs to the AV stack, and thereby generate at least one simulated agent trace and a simulated ego trace reflecting autonomous decisions taken in the AV stack in response to the simulated perception inputs, wherein later iterations of the multiple iterations are guided by the

Abstract: A computer-implemented method of predicting behaviour of an agent for executing an objective of a mobile robot in the vicinity of the agent, in dependence on the predicted behaviour comprises: determining a reference path, wherein multiple actions are available to the agent, and the reference path relates to one of those actions; projecting a measured velocity vector of the agent onto a reference path, thereby determining a projected speed value for the agent along the reference path; computing predicted agent motion data for the agent along the reference path based on the projected speed value; and generating a series of control signals for controlling a mobile robot to fulfil the objective in dependence on the predicted agent motion data.

Abstract: A method of annotating frames of a time sequence of frames captured by at least one travelling vehicle comprises, in a frame processing system: determining a three-dimensional (3D) road model for an area captured in the time sequence of frames; receiving first annotation data denoting a known 3D location of a moving object for a first frame of the time sequence of frames; and automatically generating second annotation data for marking an expected moving object location in at least a second frame of the time sequence of frames, by assuming the moving object moves along an expected path determined from the known 3D location and the 3D road model.