Abstract: A method for collision avoidance includes receiving a maneuver command, obtaining observations from one or more sensors, generating one or more constraints based on the observations, combining the maneuver command and the one or more constraints to generate a constrained maneuver command that deviates from the maneuver command for collision avoidance, sending the constrained maneuver command to a controller. The method can include modifying motion of a vehicle based on the constrained maneuver command to maneuver with collision avoidance.