Abstract: A computer-implemented method of processing images for extracting information about known objects comprises the steps of receiving an image containing a view of a known object at a scale dependent on an object distance of the known object from an image capture location of the image; determining, from a world model representing one or more known objects in the vicinity of the image capture location, an object location of the known object, the object location and the image capture location defined in a world frame of reference; and based on the image capture location and the object location in the world frame of reference, applying image scaling to the image, to extract a rescaled image containing a rescaled view of the known object at a scale that is substantially independent of the object distance from the image capture location.

Abstract: A computer-implemented method of assessing performance of perception component, the perception component for interpreting structure in a scene comprises: receiving a set of multiple computed outputs obtained by applying the perception component to the scene, wherein each computed output comprises a confidence score: generating, from the set of multiple computed outputs, multiple pseudo-ground truth sets, wherein each pseudo-ground truth set comprises, for each computed output, a pseudo-ground truth output sampled from a set of possible ground truth outputs based on a probability distribution defined by the confidence score of the computed output; computing a performance score for the perception component applied to the scene with respect to each pseudo-ground truth set, by comparing the set of multiple outputs with that pseudo-ground truth set; and computing an overall performance score for the perception component applied to the scene, by aggregating the performance scores computed with respect to the multip

Abstract: Herein, a “perception statistical performance model” (PSPM) for modeling a perception slice of a runtime stack for an autonomous vehicle or other robotic system may be used e.g. for safety/performance testing. A PSPM is configured to: receive a computed perception ground truth t; determine from the perception ground truth t, based on a set of learned parameters, a probabilistic perception uncertainty distribution of the form p(e|t), p(e|t,c), in which p(e|t,c) denotes the probability of the perception slice computing a particular perception output e given the computed perception ground truth t and the one or more confounders c, and the probabilistic perception uncertainty distribution is defined over a range of possible perception outputs, the parameters learned from a set of actual perception outputs generated using the perception slice to be modeled, wherein each confounder is a variable of the PSPM whose value characterized a physical condition on which p(e|t,c) depends.

Abstract: A computer-implemented method of perceiving structure in an environment comprises steps of: receiving at least one structure observation input pertaining to the environment; processing the at least one structure observation input in a perception pipeline to compute a perception output; determining one or more uncertainty source inputs pertaining to the structure observation input; and determining for the perception output an associated uncertainty estimate by applying, to the one or more uncertainty source inputs, an uncertainty estimation function learned from statistical analysis of historical perception outputs.

Abstract: Herein, a “perception statistical performance model” (PSPM) for modelling a perception slice of a runtime stack for an autonomous vehicle or other robotic system may be used e.g. for safety/performance testing. A PSPM is configured to receive a computed perception ground truth, and determine from the perception ground truth, based on a set of learned parameters, a probabilistic perception uncertainty distribution, the parameters learned from a set of actual perception outputs generated using the perception slice to be modelled. A simulated scenario is run based on a time series of such perception outputs (with modelled perception errors), but can also be re-run based on perception ground truths directly (without perception errors). This can, for example, be way to ascertain whether perception error was the cause of some unexpected decision within the planner, by determining whether such a decision is also taken in the simulated scenario when perception error is “switched off”.

Abstract: A method of training a 3D structure detector to detect 3D structure in 3D structure representation, the method comprising the following steps: receiving, at a trainable 3D structure detector, a set of training inputs, each training input comprising at least one 3D structure representation; the 3D structure detector determining, for each training input, a set of predicted 3D objects for the at least one 3D structure representation of that training input; and training the 3D structure detector to optimize a cost function, wherein the cost function penalizes deviation from an expected geometric relationship between the set of predicted 3D objects determined for each training in put.

Abstract: Herein, a “perception statistical performance model” (PSPM) for modelling a perception slice of a runtime stack for an autonomous vehicle or other robotic system may be used e.g. for safety/performance testing. A PSPM is configured to: receive a computed perception ground truth; determine from the perception ground truth, based on a set of learned parameters, a probabilistic perception uncertainty distribution, the parameters learned from a set of actual perception outputs generated using the perception slice to be modelled. The PSPM comprises a time-dependent model such that the perception output sampled at the current time instant depends on at least one of: an earlier one of the perception outputs sampled at a previous time instant, and an earlier one of the perception ground truths computed for a previous time instant.

Abstract: Herein, a “perception statistical performance model” (PSPM) for modelling a perception slice of a runtime stack for an autonomous vehicle or other robotic system may be used e.g. for safety/performance testing. A PSPM is configured to: receive a computed perception ground truth; determine from the perception ground truth, based on a set of learned parameters, a probabilistic perception uncertainty distribution, the parameters learned from a set of actual perception outputs generated using the perception slice to be modelled. The modelled perception slice includes an online error estimator, and the computer system is configured to use the PSPM to obtain a predicted online error estimate for the perception output in response to the perception ground truth. This recognizes that online perception error estimates may, themselves, be subject to error.

Abstract: One aspect herein pertains to a computer-implemented method of predicting agent motion comprises receiving a first observed agent state corresponding to a first time instant; determining a set of agent goals; for each agent goal, planning an agent trajectory based on the agent goal and the first observed agent state; receiving a second observed agent state corresponding to a second time instant later than the first time instant; for each goal, comparing the second observed agent state with the at least one agent trajectory planned for the goal, and thereby computing a likelihood of the goal and/or the planned agent trajectory for the goal. Another aspect pertains to trajectory generation, e.g., within a motion planner.

Abstract: Herein, a “perception statistical performance model” (PSPM) for modelling a perception slice of a runtime stack for an autonomous vehicle or other robotic system may be used e.g. for safety/performance testing. A first PSPM is configured to: receive a computed perception ground truth; determine from the perception ground truth, based on a set of learned parameters, a probabilistic perception uncertainty distribution, the parameters learned from a set of actual perception outputs generated using the perception slice to be modelled, in order to compute a first time series of perception outputs. A second time series of perception outputs is computed using a second PSPM for modelling a second perception slice of the runtime stack, the first PSPM learned from data of a first sensor modality of the perception slice and the time series, and the second PSPM learned independently thereof from data of a second sensor modality of the second perception slice and the second time series.

Abstract: A method of annotating known objects in road images captured from a sensor-equipped vehicle, the method implemented in an annotation system and comprising: receiving at the annotation system a road image containing a view of a known object; receiving ego localization data, as computed in a map frame of reference, via localization applied to sensor data captured by the sensor-equipped vehicle, the ego localization data indicating an image capture pose of the road image in the map frame of reference; determining, from a predetermined road map, an object location of the known object in the map frame of reference, the predetermined road map representing a road layout the map frame of reference, wherein the known object is one of: a piece of road structure, and an object on or adjacent a road; computing, in an image plane defined by the image capture pose, an object projection, by projecting an object model of the known object from the object location into the image plane; and storing, in an image database, image

Abstract: A computer-implemented method of perceiving structure in an environment comprises steps of: receiving at least one structure observation input pertaining to the environment; processing the at least one structure observation input in a perception pipeline to compute a perception output; determining one or more uncertainty source inputs pertaining to the structure observation input; and determining for the perception output an associated uncertainty estimate by applying, to the one or more uncertainty source inputs, an uncertainty estimation function learned from statistical analysis of historical perception outputs.

Abstract: Performance of a substitute upstream processing component is tested, in order to determine whether that performance is sufficient to support a downstream processing component, within an autonomous driving system, in place of an existing upstream processing component. The existing upstream processing component and the substitute upstream processing component are mutually interchangeable in so far as they provide the same form of outputs interpretable by the downstream processing component, such that either upstream processing component may be used without modification to the downstream processing component. A direct or indirect metric-based comparison is formulated in terms of the resulting performance of the downstream processing component.

Abstract: An encoder is trained together with a perception component based on a training set comprising unannotated sensor data sets and annotated sensor data sets in a sequence of multiple training steps.

Abstract: A computer-implemented method of perceiving structure in a radar point cloud comprises: generating a discretised image representation of the radar point cloud having (i) an occupancy channel indicating whether or not each pixel of the discretised image representation corresponds to a point in the radar point cloud and (ii) a Doppler channel containing, for each occupied pixel, a Doppler velocity of the corresponding point in the radar point cloud; and inputting the discretised image representation to a machine learning (ML) perception component, which has been trained extract information about structure exhibited in the radar point cloud from the occupancy and Doppler channels.

Abstract: A computer-implemented method of estimating a 3D object pose, the method comprising: receiving 3D data comprising a full or partial view of a 3D object, the 3D object exhibiting reflective symmetry about an unknown 2D symmetry plane; applying symmetry detection to the 3D data, and thereby calculating, in 3D space, an estimated 2D symmetry plane for the 3D object; and applying 3D pose detection to the 3D data based on the estimated 2D symmetry plane, thereby computing a 3D pose estimate of the 3D object that is informed by the reflective symmetry of the 3D object.

Abstract: In one aspect, hierarchical image segmentation is applied to an image formed of a plurality of pixels, by classifying the pixels according to a hierarchical classification scheme, in which at least some of those pixels are classified by a parent level classifier in relation to a set of parent classes, each of which is associated with a subset of child classes, and each of those pixels is also classified by at least one child level classifier in relation to one of the subsets of child classes, wherein each of the parent classes corresponds to a category of visible structure, and each of the subset of child classes associated with it corresponds to a different type of visible structure within that category.

Abstract: A computer-implemented method of evaluating the performance of a trajectory planner for a mobile robot in a real or simulated scenario, comprises receiving scenario ground truth of the scenario, the scenario ground truth generated using the trajectory planner to control an ego agent of the scenario responsive to at least one scenario element of the scenario. One or more performance evaluation rules for the scenario and at least one activation condition for each performance evaluation rule are received. A test oracle processes the scenario ground truth to determine whether the activation condition of each performance evaluation rule is satisfied over multiple time steps of the scenario. Each performance evaluation rule is evaluated by the test oracle, to provide at least one test result, only when its activation condition is satisfied.

Abstract: A computer implemented method of training an encoder to extract features from sensor data comprises generating a plurality of training examples, each training example comprising at least two data representations of a set of sensor data, the at least two data representations related by a transformation parameterized by at least one numerical transformation value; and training the encoder based on a self-supervised regression loss function applied to the training examples. The encoder extracts respective features from the at least two data representations of each training example, and at least one numerical output value is computed from the extracted features. The self-supervised regression loss function encourages the at least one numerical output value to match the at least one numerical transformation value parameterizing the transformation.

Abstract: It A computer implemented method of training an encoder to extract features from sensor data comprises training a machine learning (ML) system based on a self-supervised loss function applied to a training set, the ML system comprising the encoder. The training set comprises first data representations and corresponding second data representations, wherein the encoder extracts features from each first and second data representation, and wherein the self-supervised loss function encourages the ML system to associate each first data representation with its corresponding second data representation based on their respective features.