Abstract: System and method are provided to detect objects in a scene frame of two-dimensional (2D) video using image processing and determine object image coordinates of the detected objects in the scene frame. The system and method deploy a virtual camera in a three-dimensional (3D) environment to create a virtual image frame in the environment and generate a floor in the environment in a plane below the virtual camera. The system and method adjust the virtual camera to change a height and angle relative to the virtual image frame. The system and method generate at an extended reality (XR) coordinate location relative to the floor for placing the detected object in the environment. The XR coordinate location is a point of intersection of a ray cast of the virtual camera through the virtual frame on the floor that translates to the image coordinate in the virtual image frame.