Abstract: A method comprises: capturing images of a movable object in a scene and tracking movement of the object in the scene based on the images, to produce movement parameters that define the movement; generating for display an extended reality (XR) visualization of the physical object in the scene and changing the XR visualization responsive to changing ones of the movement parameters, such that the XR visualization visually reflects the tracked movement; displaying the XR visualization; and converting the movement parameters to control messages configured to control one or more of sound and light, and transmitting the control messages.