Abstract: The present disclosure relates to methods, apparatus and systems for automatically adapt the zoom coefficient of the camera of a system when running an augmented reality application. A pose estimation is performed for the camera which captures the real scene and the boundaries of the AR scene are calculated. According to the camera frustum and the boundaries, three-dimension rectangles are computes to determine a zoom coefficient that would optimize the seeing of the seen and the optimal position for the camera. The zoom is automatically optically or digitally adapted and the optimal position is indicated to the user by visual, audio or haptic means.

Abstract: Dynamic virtual content(s) to be superimposed to a representation of a real 3D scene complies with a scenario defined before runtime and involving real-world constraints (23). Real-world information (22) is captured in there a1 3D scene and the scenario is executed at runtime (14) in presence of there a1-world constraints. When there a1-world constraints are not identified (12) from there a1-world information, a transformation of the representation of the real 3D scene to a virtually adapted 3D scene is carried out (13) before executing the scenario, so that the virtually adapted 3D scene fulfills those constraints, and the scenario is executed in the virtually adapted 3D scene replacing the real 3D scene instead of there a1 3D scene. Application to mixed reality.

Abstract: A method and device are described for time aligning a current frame of a current video stream with respect to reference frames of a reference video stream, the current video stream corresponding to at least one part of the reference video stream. The method includes: obtaining at least two reference frames corresponding to at least part of at least some of multiple displayed frames displayed on a display; obtaining current frame from images of said displayed frames captured with a camera by shooting said display; and determining a time alignment of said current frame with respect to said at least two reference frames by correlating said current frame with a time interpolation of said at least two reference frames. The time interpolation being based on correlations between the current frame and respectively each of the at least two reference frames, and on at least one correlation between at least two of the selected reference frames together.

Abstract: An apparatus and a method for controlling the same by a user are suggested. The suggested apparatus comprises: a detecting unit for detecting a first event executed by a user in relation to a plurality of devices including the apparatus; a control unit for generating a second event according to the first event detected by the detecting unit; an output unit for presenting the second event to the user, wherein the control unit generates a command for executing the first event on the apparatus as a function of a response of the user to the second event detected by the detecting unit. The suggested apparatus and method are suitable to provide a second event, before executing a command corresponding to a first event from the user, for the user to confirm the intention of the first event.

Abstract: The present disclosure relates to methods, apparatus and systems for automatically adapt the zoom coefficient of the camera of a system when running an augmented reality application. A pose estimation is performed for the camera which captures the real scene and the boundaries of the AR scene are calculated. According to the camera frustum and the boundaries, three-dimension rectangles are computes to determine a zoom coefficient that would optimize the seeing of the seen and the optimal position for the camera. The zoom is automatically optically or digitally adapted and the optimal position is indicated to the user by visual, audio or haptic means.

Abstract: A method for rendering a non-photorealistic (NPR) content from a set (SI) of at least one image of a same scene is provided. The set of images (SI) is associated with a depth image comprising a set of regions. Each region corresponds to a region of a given depth. The method for rendering a non-photorealistic content includes generation of a segmented image having at least one segmented region generated with a given segmentation scale. The at least one segmented region corresponds to at least one region of the set of regions. A binary edge image is generated in which at least one binary edge region is generated with a given edge extraction scale, the at least one binary edge region corresponding to at least one region of the set of regions. The non-photorealistic content is rendered by combining the segmented image and the binary edge image.

Abstract: A method for shooting a performance making use of umanned aerial vehicles, such as drones for example, to provide the physical markers that are needed to give a physical actor indications on the positioning of virtual elements to be inserted later in the scene, and with which s/he needs to interact.

Abstract: A method of displaying a neutral facial expression in a paused video includes analyzing contiguous frames of a video to find neutral facial expressions and associating one of the neutral facial expression frames with each frame in the video. Upon reception of a pause instruction, synthesizing a set of frames that transition from the associated neutral expression frame to a pause frame. The synthesized frames are played in reverse, whereby the played frames transition from the pause frame to the associated neutral expression frame. Thus, the neutral facial expression frame is displayed on the video player while the video is paused instead of displaying the normal pause frame.

Abstract: An apparatus and a method for controlling the same by a user are suggested. The suggested apparatus comprises: a detecting unit for detecting a first event executed by a user in relation to a plurality of devices including the apparatus; a control unit for generating a second event according to the first event detected by the detecting unit; an output unit for presenting the second event to the user, wherein the control unit generates a command for executing the first event on the apparatus as a function of a response of the user to the second event detected by the detecting unit. The suggested apparatus and method are suitable to provide a second event, before executing a command corresponding to a first event from the user, for the user to confirm the intention of the first event.

Abstract: A method and an apparatus for generating the depth map of a scene are described. The method comprises the steps of: projecting a structured light pattern with homogeneous density onto the scene to obtain a first depth map; segmenting the scene into at least one area based on the depth information in the first depth map; and projecting a structured light pattern with a heterogeneous density onto the scene by adapting the density of the light pattern to the at least one area of the scene to obtain a second depth map of the scene.

Abstract: The present invention discloses a method for shooting a performance making use of umanned aerial vehicles, such drones for example, to provide the physical markers that are needed to give a physical actor indications on the positioning of virtual elements to be inserted later in the scene, and with which s/he needs to interact.