Abstract: This document discloses system, method, and computer program product embodiments for operating an autonomous vehicle (AV). For example, the method includes performing the following operations by a muxing tool when AV is deployed within a particular geographic area in a real-world environment: receiving perception data that is representative of at least one actual object which is perceived while AV is deployed within the particular geographic area in a real-world environment; receiving simulation data that represents a simulated object that could be perceived by AV in the real-world environment and that was generated using a simulation scenario which is selected from a plurality of simulation scenarios based on at least one of the particular geographic area in which AV is currently located and a current operational state of AV; and generating augmented perception data by combining the simulation data with the perception data.

Abstract: This document describes methods by which an autonomous vehicle deploys a simulation scenario while operating in a real-world environment. The vehicle's sensors collect perception data. During a run of the vehicle in a real-world environment, the vehicle's on-board computing system will: (i) receive the perception data; (ii) publish the perception data to a muxing tool of the on-board computing system; (iii) generate simulation data that identifies and labels one or more simulated objects in the environment; (iv) publish the simulation data to the muxing tool; (v) use the muxing tool to add at least a portion of the simulation data to the perception data to yield augmented perception data; and (v) use at least a portion of the augmented perception data to make one or more navigation decisions based for the autonomous vehicle.

Abstract: This document discloses system, method, and computer program product embodiments for operating an autonomous vehicle (AV). For example, the method includes performing the following operations by a muxing tool when AV is deployed within a particular geographic area in a real-world environment: receiving perception data that is representative of at least one actual object which is perceived while AV is deployed within the particular geographic area in a real-world environment; receiving simulation data that represents a simulated object that could be perceived by AV in the real-world environment and that was generated using a simulation scenario which is selected from a plurality of simulation scenarios based on at least one of the particular geographic area in which AV is currently located and a current operational state of AV; and generating augmented perception data by combining the simulation data with the perception data.

Abstract: This document describes methods by which an autonomous vehicle deploys a simulation scenario while operating in a real-world environment. The vehicle's sensors collect perception data. During a run of the vehicle in a real-world environment, the vehicle's on-board computing system will: (i) receive the perception data; (ii) publish the perception data to a muxing tool of the on-board computing system; (iii) generate simulation data that identifies and labels one or more simulated objects in the environment; (iv) publish the simulation data to the muxing tool; (v) use the muxing tool to add at least a portion of the simulation data to the perception data to yield augmented perception data; and (v) use at least a portion of the augmented perception data to make one or more navigation decisions based for the autonomous vehicle.