Abstract: A head-mounted display (HMD) device is disclosed. The HMD device includes a frame and a display system coupled to the frame. A stereo depth camera system coupled to the frame generates stereo depth camera information comprising frames of imagery and depth data that identifies a distance to a simulator cockpit of a simulator. A processor device is coupled to the stereo depth camera system and to the display system. The processor device identifies, based on the stereo depth camera information, a particular cockpit model that corresponds to the simulator cockpit and that identifies a layout of cockpit controls of the simulator cockpit. The processor device, based at least in part on the cockpit model and a physical location of the simulator cockpit, generates computer-generated imagery. The processor device sends the computer-generated imagery to the display system to overlay the computer-generated imagery on top of a portion of a real-world scene.

Abstract: A head-mounted display (HMD) device is disclosed. The HMD device includes a frame and a display system coupled to the frame. A stereo depth camera system coupled to the frame generates stereo depth camera information comprising frames of imagery and depth data that identifies a distance to a simulator cockpit of a simulator. A processor device is coupled to the stereo depth camera system and to the display system. The processor device identifies, based on the stereo depth camera information, a particular cockpit model that corresponds to the simulator cockpit and that identifies a layout of cockpit controls of the simulator cockpit. The processor device, based at least in part on the cockpit model and a physical location of the simulator cockpit, generates computer-generated imagery. The processor device sends the computer-generated imagery to the display system to overlay the computer-generated imagery on top of a portion of a real-world scene.

Abstract: A method comprising detecting, by a processor, an optical sight of a device in range of a lens of a head mounted display (HMD) apparatus. The lens has an HMD field of view (H-FOV) of a real-world view. The method comprises determining, by the processor, a magnification factor of a sight field of view (S-FOV) for the detected sight. The method includes displaying, by a display device of the HMD apparatus, computer generated data (CGD) in the S-FOV relative to a magnification level according to the magnification factor of the S-FOV of the real-world view while looking through the sight. A system and computer readable medium are also provided.