Abstract: A camera captures part of a surrounding scene to obtain a user view, disambiguating information uniquely identifying at least one controllable device or group of controllable devices in a set of controllable devices of a given type or at least one location or direction for a mobile controllable device is obtained, the user view and the disambiguating information relating to at least one controllable device overlaid on the user view are displayed on a display, a command intended to control at least one controllable device is received, wherein a command including at least part of the disambiguating information and a message based on the command is sent towards a corresponding controllable device.

Abstract: A method for a placement of a virtual object of an augmented or mixed reality application in a real-world 3D environment, comprises: selecting (14), at a runtime of the augmented or mixed reality application, one of a finite set of at least two candidate insertion areas predetermined in the real-world 3D environment for the placement of the virtual object in the real-world 3D environment, based on criteria combining, for each of the candidate insertion areas, relationships between each of: the real-world 3D environment, the virtual object considered with respect to a placement of that virtual object in that candidate insertion area, and a user position; and inserting (14) the virtual object in the selected candidate insertion area.

Abstract: In an augmented reality system, helper data are associated to augmented reality anchors to describe the surroundings of the anchor in the real environment. This allows to verify that positional tracking is correct, in other words, that an augmented reality terminal is localized at the right place in an augmented reality scene. This helper data may be shown on request. Typical examples of helper data are a cropped 2D image or a 3D mesh.

Abstract: In an augmented reality system, a map of the real environment is generated from a 3D textured mesh obtained through captured data representing the real environment. Some processing is done on the mesh to remove unnecessary elements and generate the map that comprises a set of 2D pictures: one picture for the ground level and one picture for the other elements of the scene. The generated map may then be rendered on an augmented reality device. The ground and the non-ground content may be rendered independently, then additional elements, such as other users of the augmented reality scene or virtual objects, are localized and represented in the map in real-time using a proxy. The rendering can be adapted to the user poses and to the devices themselves.

Abstract: A method of sharing and a method of presenting virtual content in a mixed reality scene rendered on at least two user devices having different viewing position and/or orientation onto the mixed reality scene and corresponding apparatus are described. At a first user device, a user is enabled to select a virtual content to be shared and a second user device with whom the virtual content is to be shared. Information related to the virtual content to be shared is provided, wherein the provided information comprises the 3D position of the virtual content to be shared. The information is received by the second user device and the shared virtual content is rendered with regard to the viewing position and/or orientation of the second user device onto the mixed reality scene.

Abstract: A method of sharing and a method of presenting virtual content in a mixed reality scene rendered on at least two user devices having different viewing position and/or orientation onto the mixed reality scene and corresponding apparatus are described. At a first user device, a user is enabled to select a virtual content to be shared and a second user device with whom the virtual content is to be shared. Information related to the virtual content to be shared is provided, wherein the provided information comprises the 3D position of the virtual content to be shared. The information is received by the second user device and the shared virtual content is rendered with regard to the viewing position and/or orientation of the second user device onto the mixed reality scene.

Abstract: According to embodiments, a (e.g., plurality of) lighting model(s) may be computed from a scene model by a processing device. The model (e.g., a geometric model of the scene complemented by a lighting model(s)) may be stored, for example on the processing device. The processing device may be coupled with a user interface running on any of the processing device or another (e.g., Tenderer) device. According to embodiments, a (e.g., specific) scene, for example, among a set of possible scenes, may be selected via the user interface, for being rendered by the AR application on any of the processing device and a (e.g., different) Tenderer device. According to embodiments, a (e.g., specific, virtual) outdoor lighting condition may be selected via the user interface, and a rendering of the selected scene may be adapted by the AR application according to the selected outdoor lighting condition.

Abstract: A method of sharing and a method of presenting virtual content in a mixed reality scene rendered on at least two user devices having different viewing position and/or orientation onto the mixed reality scene and corresponding apparatus are described. At a first user device, a user is enabled to select a virtual content to be shared and a second user device with whom the virtual content is to be shared. Information related to the virtual content to be shared is provided, wherein the provided information comprises the 3D position of the virtual content to be shared. The information is received by the second user device and the shared virtual content is rendered with regard to the viewing position and/or orientation of the second user device onto the mixed reality scene.

Abstract: Dynamic virtual content(s) to be superimposed to a representation of a real 3D scene complies with a scenario defined before run-time and involving real-world constraints (23). Real-world information (22) is captured in there al 3D scene and the scenario is executed at runtime (14) in presence of there al-world constraints. When there al-world constraints are not identified (12) from there al-world information, a transformation of the representation of the real 3D scene to a virtually adapted 3D scene is carried out (13) before executing the scenario, so that the virtually adapted 3D scene fulfills those constraints, and the scenario is executed in the virtually adapted 3D scene replacing the real 3D scene instead of there al 3D scene. Application to mixed reality.

Abstract: Localization of a user device in a mixed reality environment in which the user device obtains at least one keyframe from a server, which can reside on the user device, displays at least one of the keyframes on a screen, captures by a camera an image of the environment, and obtains a localization result based on at least one feature of at least one keyframe and the image.

Abstract: A method of sharing and a method of presenting virtual content in a mixed reality scene rendered on at least two user devices having different viewing position and/or orientation onto the mixed reality scene and corresponding apparatus are described. At a first user device, a user is enabled to select a virtual content to be shared and a second user device with whom the virtual content is to be shared. Information related to the virtual content to be shared is provided, wherein the provided information comprises the 3D position of the virtual content to be shared. The information is received by the second user device and the shared virtual content is rendered with regard to the viewing position and/or orientation of the second user device onto the mixed reality scene.

Abstract: A method for a placement of a virtual object of an augmented or mixed reality application in a real-world 3D environment, comprises: selecting (14), at a runtime of the augmented or mixed reality application, one of a finite set of at least two candidate insertion areas predetermined in the real-world 3D environment for the placement of the virtual object in the real-world 3D environment, based on criteria combining, for each of the candidate insertion areas, relationships between each of: the real-world 3D environment, the virtual object considered with respect to a placement of that virtual object in that candidate insertion area, and a user position; and inserting (14) the virtual object in the selected candidate insertion area.

Abstract: A method for a placement of a virtual object of an augmented or mixed reality application in a real-world 3D environment, comprises: selecting (14), at a runtime of the augmented or mixed reality application, one of a finite set of at least two candidate insertion areas predetermined in the real-world 3D environment for the placement of the virtual object in the real-world 3D environment, based on criteria combining, for each of the candidate insertion areas, relationships between each of: the real-world 3D environment, the virtual object considered with respect to a placement of that virtual object in that candidate insertion area, and a user position; and inserting (14) the virtual object in the selected candidate insertion area.

Abstract: A method and apparatus is provided for enhancing immersive experiences. The progress of a virtual reality content provided in mixed reality environment is monitored. The mixed reality environment incorporates virtual reality content with images provided from a real environment. In addition, at least one virtual acoustic data associated with the virtual reality content is obtained and modified by incorporating said images provided in the real environment.

Abstract: Dynamic virtual content(s) to be superimposed to a representation of a real 3D scene complies with a scenario defined before run-time and involving real-world constraints (23). Real-world information (22) is captured in there al 3D scene and the scenario is executed at runtime (14) in presence of there al-world constraints. When there al-world constraints are not identified (12) from there al-world information, a transformation of the representation of the real 3D scene to a virtually adapted 3D scene is carried out (13) before executing the scenario, so that the virtually adapted 3D scene fulfills those constraints, and the scenario is executed in the virtually adapted 3D scene replacing the real 3D scene instead of there al 3D scene. Application to mixed reality.

Abstract: Dynamic virtual content(s) to be superimposed to a representation of a real 3D scene complies with a scenario defined before runtime and involving real-world constraints (23). Real-world information (22) is captured in the real 3D scene and the scenario is executed at runtime (14) in presence of the real-world constraints. When the real-world constraints are not identified (12) from the real-world information, a transformation of the representation of the real 3D scene to a virtually adapted 3D scene is carried out (13) before executing the scenario, so that the virtually adapted 3D scene fulfills those constraints, and the scenario is executed in the virtually adapted 3D scene replacing the real 3D scene instead of the real 3D scene. Application to mixed reality.

Abstract: A method of sharing and a method of presenting virtual content in a mixed reality scene rendered on at least two user devices having different viewing position and/or orientation onto the mixed reality scene and corresponding apparatus are described. At a first user device, a user is enabled to select a virtual content to be shared and a second user device with whom the virtual content is to be shared. Information related to the virtual content to be shared is provided, wherein the provided information comprises the 3D position of the virtual content to be shared. The information is received by the second user device and the shared virtual content is rendered with regard to the viewing position and/or orientation of the second user device onto the mixed reality scene.

Abstract: A method for a placement of a virtual object of an augmented or mixed reality application in a real-world 3D environment, comprises: selecting (14), at a runtime of the augmented or mixed reality application, one of a finite set of at least two candidate insertion areas predetermined in the real-world 3D environment for the placement of the virtual object in the real-world 3D environment, based on criteria combining, for each of the candidate insertion areas, relationships between each of: the real-world 3D environment, the virtual object considered with respect to a placement of that virtual object in that candidate insertion area, and a user position; and inserting (14) the virtual object in the selected candidate insertion area.

Abstract: In order to blur a virtual object in a video in real time as the video is acquired by a device capturing a real scene, a salient idea is used which estimates an apparent motion vector between two successive images, being captured at two successive device poses, in which the apparent motion vector estimation is based on a motion of the device. The successive images are then filtered based on the estimated apparent motion vector.

Abstract: A method of selection of an object in an environment including a plurality of real and/or virtual objects is described. The environment being displayed to a user through a display device includes an assignment of a gesture path to each object of the plurality of objects and the gesture path includes a series of gestures to be performed by the user to select the object.