Abstract: A computer-implemented method of evaluating the performance of a trajectory planner in simulation comprises miming first instances of a scenario in a simulator, the first instances run with a first set of parameterizations of the scenario, the trajectory planner used to control an ego agent responsive in each scenario instance; evaluating performance of the trajectory planner in each scenario instance, thereby computing a set of test results for the first set of scenario parameterizations; identifying at least one target parameterization of the first set based on the set of test results; and based on the target parameterization, determining a second set of parameterizations of the scenario for miming second instances of the scenario for exploring a subspace of the parameter space in the vicinity of the target parameterization.

Abstract: A computer system for testing the performance of a stack for planning ego vehicle trajectories in real or simulated driving scenarios, the computer system comprising: at least a first input configured to receive (i) scenario ground truth and (ii) internal state data of the stack, the scenario ground truth and internal state data generated using the stack to control an ego agent responsive to at least one other agent in the simulated driving scenario; at least a second input configured to receive a defined operational design domain (ODD); a test oracle configured to apply one or more driving rules to the scenario ground truth for evaluating the performance of the stack in the scenario, and provide an output for each of the driving rules indicating whether that driving rule has been complied with; wherein the one or more driving rules include at least one ODD-based response rule, the test oracle configured to apply the ODD-based response rule by: processing the scenario ground truth over multiple time steps, to

Abstract: A computer implemented method for generating a simulation environment for testing an autonomous vehicle, the method comprising generating a scenario comprising a dynamic interaction between an ego object and challenger object, the interaction being defined relative to a static scene topology. The method comprises providing a dynamic layer comprising parameters of the dynamic interaction and a static layer comprising the static scene topology to a simulator, searching a store of maps to access a map having a matching scene topology to the static scene topology, and generating a simulated version of the dynamic interaction using the matching scene topology.

Abstract: It A computer implemented method of training an encoder to extract features from sensor data comprises training a machine learning (ML) system based on a self-supervised loss function applied to a training set, the ML system comprising the encoder. The training set comprises first data representations and corresponding second data representations, wherein the encoder extracts features from each first and second data representation, and wherein the self-supervised loss function encourages the ML system to associate each first data representation with its corresponding second data representation based on their respective features.

Abstract: A computer implemented method of training an encoder to extract features from sensor data comprises training a machine learning (ML) system based on a self-supervised loss function applied to a training set, the ML system comprising the encoder. The training set comprises sets of real sensor data and corresponding sets of synthetic sensor data. The encoder extracts features from each set of real and synthetic sensor data, and the self-supervised loss function encourages the ML system to associate each set of real sensor data with its corresponding set of synthetic sensor data based on their respective features.

Abstract: An in-stream disparity processing system comprises a delay block having an input for receiving an input stream of disparity cost vectors, and configured to provide a delayed stream of disparity cost vectors at an output of the delay block, by delaying the input stream by a predetermined amount; and a processing block having a cost input connected to receive the delayed stream of disparity cost vectors and a smoothing input connected to receive the input stream of disparity cost vectors, and configured to apply cost smoothing to the delayed stream based on the input stream, so as to generate, at an output of the processing block, a stream of reverse pass disparity cost vectors.

Abstract: An occlusion metric is computed for a target object in a 3D multi-object simulation. The target object is represented in 3D space by a collision surface and a 3D bounding box. In a reference surface defined in 3D space, a bounding box projection is determined for the target object with respect to an ego location. The bounding box projection is used to determine a set of reference points in 3D space. For each reference point of the set of reference points, a corresponding ray is cast based on the ego location, and it is determined whether the ray is an object ray that intersects the collision surface of the target object. For each such object ray, it is determined whether the object ray is occluded. The occlusion metric conveys an extent to which the object rays are occluded.

Abstract: A method of annotating known objects in road images captured from a sensor-equipped vehicle, the method implemented in an annotation system and comprising: receiving at the annotation system a road image containing a view of a known object; receiving ego localization data, as computed in a map frame of reference, via localization applied to sensor data captured by the sensor-equipped vehicle, the ego localization data indicating an image capture pose of the road image in the map frame of reference; determining, from a predetermined road map, an object location of the known object in the map frame of reference, the predetermined road map representing a road layout the map frame of reference, wherein the known object is one of: a piece of road structure, and an object on or adjacent a road; computing, in an image plane defined by the image capture pose, an object projection, by projecting an object model of the known object from the object location into the image plane; and storing, in an image database, image

Abstract: A computer-implemented method of modelling a perception system, the perception system configured to receive sensor data and interpret the sensor data to generate actual perception outputs, comprises: receiving a plurality of input samples, wherein each input sample comprises sensor data and is associated with one or more training perception ground truths pertaining to one or more ground truth objects; providing the sensor data of each input sample to the perception system to be modelled, wherein the perception system interprets the sensor data, in order to generate one or more actual perception outputs for the input sample; and training a function approximator to model the perception system by: for each input sample, inputting the training perception ground truths to the function approximator, wherein the function approximator computes one or more predicted perception values by processing the training perception ground truths but not the sensor data from which the actual perception outputs are generated, and

Abstract: A computer-implemented method of evaluating the performance of a target planner for an ego robot in a real or simulated scenario, the method comprising: receiving evaluation data for evaluating the performance of the target planner in the scenario, the evaluation data generated by applying the target planner at incrementing planning steps, in order to compute a series of ego plans that respond to changes in the scenario, the series of ego plans being implemented in the scenario to cause changes in an ego state the evaluation data comprising: the ego plan computed by the target planner at one of the planning steps, and a scenario state at a time instant of the scenario, wherein the evaluation data is used to evaluate the target planner by: computing a reference plan for said time instant based on the scenario state, the scenario state including the ego state at that time instant as caused by implementing one or more preceding ego plans of the series of ego plans computed by the target planner, and computing at

Abstract: In one aspect, hierarchical image segmentation is applied to an image formed of a plurality of pixels, by classifying the pixels according to a hierarchical classification scheme, in which at least some of those pixels are classified by a parent level classifier in relation to a set of parent classes, each of which is associated with a subset of child classes, and each of those pixels is also classified by at least one child level classifier in relation to one of the subsets of child classes, wherein each of the parent classes corresponds to a category of visible structure, and each of the subset of child classes associated with it corresponds to a different type of visible structure within that category.

Abstract: In one aspect, a vehicle localization system implements the following steps: receiving a predetermined road map; receiving at least one captured image from an image capture device of a vehicle; processing, by a road detection component, the at least one captured image, to identify therein road structure for matching with corresponding structure of the predetermined road map, and determine a location of the vehicle relative to the identified road structure; and using the determined location of the vehicle relative to the identified road structure to determine a location of the vehicle on the road map, by matching the road structure identified in the at least one captured image with the corresponding road structure of the predetermined road map.

Abstract: Herein, a “perception statistical performance model” (PSPM) for modelling a perception slice of a runtime stack for an autonomous vehicle or other robotic system may be used e.g. for safety/performance testing. A PSPM is configured to: receive a computed perception ground truth; determine from the perception ground truth, based on a set of learned parameters, a probabilistic perception uncertainty distribution, the parameters learned from a set of actual perception outputs generated using the perception slice to be modelled. The PSPM comprises a time-dependent model such that the perception output sampled at the current time instant depends on at least one of: an earlier one of the perception outputs sampled at a previous time instant, and an earlier one of the perception ground truths computed for a previous time instant.

Abstract: Herein, a “perception statistical performance model” (PSPM) for modelling a perception slice of a runtime stack for an autonomous vehicle or other robotic system may be used e.g. for safety/performance testing. A PSPM is configured to: receive a computed perception ground truth; determine from the perception ground truth, based on a set of learned parameters, a probabilistic perception uncertainty distribution, the parameters learned from a set of actual perception outputs generated using the perception slice to be modelled. The modelled perception slice includes an online error estimator, and the computer system is configured to use the PSPM to obtain a predicted online error estimate for the perception output in response to the perception ground truth. This recognizes that online perception error estimates may, themselves, be subject to error.

Abstract: A computer-implemented method of creating 2D annotation data for annotating one or more perception inputs comprises: receiving at the annotation computer system at least one captured frame comprising a set of 3D structure points, in which at least a portion of a structure component is captured; computing a reference position for the structure component within the frame; generating a 3D model for the structure component by selectively extracting 3D structure points of the frame based on the reference position; computing a projection of the 3D model into an image plane; and storing 2D annotation data of the computed projection in persistent computer storage for annotating the structure component within the image plane.

Abstract: Depth information is extracted from a stereoscopic image pait by an image processing system. For each pixel of a target image of the stereoscopic image pair, a final disparity cost vector is computed having cost components corresponding to different disparities. The final disparity cost vector is stored in association with that pixel. That pixel is assigned the disparity corresponding to the lowest cost component of the final disparity cost vector, wherein the extracted depth information comprises the disparities assigned to the pixels of the target image. For at least a subset of the pixels of the target image, the final disparity cost vector is computed for each of those pixels by computing, with respect to the reference image, a set of matching costs for that pixel and the different disparities, and combining the matching costs with the one or more final disparity cost vectors stored in association with one or more of the adjacent pixels of the target image.

Abstract: A computer-implemented method of planning a path for a mobile robot in the presence of a set of obstacles comprises: computing for each obstacle a probabilistic obstacle position distribution; computing at least one path-independent function as a combination of the probabilistic obstacle position distributions; and for at least one candidate path, determining an upper bound on the total probability of obstacle collision along that path, by aggregating the path-independent function based on an area defined by the candidate path and a mobile robot shape, wherein the path-independent function is independent of the candidate path.

Abstract: A computer-implemented method of training a depth uncertainty estimator comprises receiving, at a training computer system, a set of training examples, each training example comprising (i) a stereo image pair and (ii) an estimated disparity map computed from at least one image of the stereo image pair by a depth estimator. The training computer system executes a training process to learn one or more uncertainty estimation parameters of a perturbation function, the uncertainty estimation parameters for estimating uncertainty in disparity maps computed by the depth estimator. The training process is performed by sampling a likelihood function based on the training examples and the perturbation function, thereby obtaining a set of sampled values for learning the one or more uncertainty estimation parameters.

Abstract: In one aspect, a method of extracting depth information from a stereoscopic pair of images comprises: in a first depth extraction phase, determining a set of support points in 3D space for at least a first image of the stereoscopic image pair; using the set of support points to determine a 3D surface prior; and in a second depth extraction phase, computing, for the first image, a second-stage disparity map, by optimizing a second cost function defined so as to penalize deviation in the second-stage disparity map from the 3D surface prior. Disparity smoothness may be encouraged in at least one of the first and second depth extraction phases using a cost function that penalizes deviations in disparity between nearby pixels.

Abstract: An imaging system for an autonomous vehicle comprises a camera for capturing images within a first field of view, a transparent disc arranged in front of the camera such that the transparent disc covers the field of view of the camera, an actuator configured to rotate the transparent disc, and a mounting arrangement configured to mount the camera, the transparent disc and the actuator on an autonomous vehicle. Also described is an imaging system comprises a camera for capturing images within a first field of view through a transparent surface, and a fluid dispenser constructed and arranged to spray a fluid onto the transparent surface within the first field of view. Also described is an image capture system for an autonomous vehicle comprising two such cameras with respective transparent discs and actuators.