Abstract: A virtual reality (VR) system comprising a head-mounted display (HMD) and handheld controller set is enhanced to provide a more realistic end user VR experience. According to this disclosure, a chroma-keyed trainer is embedded in the VR environment for use in workouts. This creates the illusion that the trainer is with the user in the virtual room. To create this effect, the trainer is filmed using a chroma key setup (e.g., a green screen background) and with standard cameras. The video is used in the headset with the keyed color (green) removed. As the training video is rendered, a set of virtual reality (VR) events that have been synchronized to movements of the trainer in the training video are output to the user so that the trainer actively participates in the workout with the user.

Abstract: A virtual reality (VR) system comprising a head-mounted display (HMD) and handheld controller set is enhanced to provide a more realistic end user VR experience, e.g., for generalized surface interactions in the VR environment. The techniques herein leverage controller-less calibration with any type of surface, followed by surface interactions in the VR environment. An example use case is an interactive fitness training session.

Abstract: A virtual reality (VR) system comprising a head-mounted display (HMD) and handheld controller set is enhanced to provide a more realistic end user VR experience, e.g., for generalized surface interactions in the VR environment. The techniques herein leverage controller-less calibration with any type of surface, followed by surface interactions in the VR environment. An example use case is an interactive fitness training session.