Abstract: Herein, a “perception statistical performance model” (PSPM) for modelling a perception slice of a runtime stack for an autonomous vehicle or other robotic system may be used e.g. for safety/performance testing. A PSPM is configured to: receive a computed perception ground truth; determine from the perception ground truth, based on a set of learned parameters, a probabilistic perception uncertainty distribution, the parameters learned from a set of actual perception outputs generated using the perception slice to be modelled. The PSPM comprises a time-dependent model such that the perception output sampled at the current time instant depends on at least one of: an earlier one of the perception outputs sampled at a previous time instant, and an earlier one of the perception ground truths computed for a previous time instant.

Abstract: A computer-implemented method of training a depth uncertainty estimator comprises receiving, at a training computer system, a set of training examples, each training example comprising (i) a stereo image pair and (ii) an estimated disparity map computed from at least one image of the stereo image pair by a depth estimator. The training computer system executes a training process to learn one or more uncertainty estimation parameters of a perturbation function, the uncertainty estimation parameters for estimating uncertainty in disparity maps computed by the depth estimator. The training process is performed by sampling a likelihood function based on the training examples and the perturbation function, thereby obtaining a set of sampled values for learning the one or more uncertainty estimation parameters.

Abstract: A computer-implemented method of perceiving structure in an environment comprises steps of: receiving at least one structure observation input pertaining to the environment; processing the at least one structure observation input in a perception pipeline to compute a perception output; determining one or more uncertainty source inputs pertaining to the structure observation input; and determining for the perception output an associated uncertainty estimate by applying, to the one or more uncertainty source inputs, an uncertainty estimation function learned from statistical analysis of historical perception outputs.

Abstract: A computer-implemented method of training a depth uncertainty estimator comprises receiving, at a training computer system, a set of training examples, each training example comprising (i) a stereo image pair and (ii) an estimated disparity map computed from at least one image of the stereo image pair by a depth estimator. The training computer system executes a training process to learn one or more uncertainty estimation parameters of a perturbation function, the uncertainty estimation parameters for estimating uncertainty in disparity maps computed by the depth estimator. The training process is performed by sampling a likelihood function based on the training examples and the perturbation function, thereby obtaining a set of sampled values for learning the one or more uncertainty estimation parameters.