Abstract: The present disclosure relates to providing composite media streams based on a live recording of a real scene and a synchronous virtual scene. A method for providing composite media streams comprises recording a real scene using a real camera; creating a three-dimensional representation of the real scene based on the recording; synchronizing a virtual camera inside a virtual scene with the real camera; generating a representation of the virtual scene using the virtual camera; compositing at least the three-dimensional representation of the real scene with the representation of the virtual scene to generate a media stream; and providing the media stream at the real camera. A camera device, a processing pipeline for compositing media streams, and a system are defined.

Abstract: A method and a processing pipeline for driving a simulated virtual environment with real data are described. The method is described with regard to visualization and interaction with real and virtual data in simulated virtual environments. The method for driving a simulated virtual environment with real data comprises providing a simulated virtual environment including a plurality of virtual objects in a virtual scene, providing captured data related to one or more real objects of a real scene to the virtual environment, assigning the captured data to corresponding virtual objects, updating the plurality of virtual objects in the virtual scene, and rendering the virtual scene of the simulated virtual environment, wherein the virtual scene is rendered in real time with regard to providing the captured data. A system for driving a simulated virtual environment with real data is also described.