Abstract: A head-mounted display (HMD) for an augmented reality system allows a user to view an augmented scene comprising a real-world portion of a live scene combined with virtual images overlaying an infrared (IR) portion of the live scene. The HMD includes a head-wearable frame, a lens defining a user field of view (FOV), and a camera. The lens permits the user to view a live scene corresponding to the user FOV, and the camera is configured to capture a captured image of the live scene containing data indicative of an infrared (IR) portion of the live scene. The IR portion of the live scene includes reflected IR light above a predetermined threshold, such as an IR reflective background surface in a simulation environment. Based on the IR portion, a virtual image is displayed on an interior surface of the lens so that the virtual image overlays the IR portion.