Abstract: The disclosed technology provides solutions for evaluating sensor calibration algorithms and in particular, for evaluating calibration mechanisms used in autonomous vehicle (AV) deployments. The disclosed technology encompasses a process that includes steps for determining calibration parameters for a sensor mounted to an autonomous vehicle (AV), determining a fault injection offset for at least one of the one or more calibration parameters, and modifying at least one of the one or more calibration parameters based on the fault injection offset. The process may additionally include steps for collecting sensor data from the sensor and evaluating a calibration algorithm associated with the sensor based on the fault injection offset and sensor data. Systems and machine-readable media are also provided.