Abstract: A camera captures part of a surrounding scene to obtain a user view, disambiguating information uniquely identifying at least one controllable device or group of controllable devices in a set of controllable devices of a given type or at least one location or direction for a mobile controllable device is obtained, the user view and the disambiguating information relating to at least one controllable device overlaid on the user view are displayed on a display, a command intended to control at least one controllable device is received, wherein a command including at least part of the disambiguating information and a message based on the command is sent towards a corresponding controllable device.

Abstract: A first communication device, e.g., having a camera, is pointed, by a first person, in direction of a second person with which the first person wants to communicate in an interactive session, using his communication device. The camera captures the face of the second person. If the second person does not have a device enabling interaction with the first device, a third person in proximity of the second person, having a device enabling interaction, is selected, and a request is transmitted to the second device in the hands of the third person to handover his device to the second person, displaying, for example, the face of the second person. When handover is detected, the second person may be identified by the device being handed over. The interaction between the first and the second device may be established.

Abstract: In an augmented reality system, a map of the real environment is generated from a 3D textured mesh obtained through captured data representing the real environment. Some processing is done on the mesh to remove unnecessary elements and generate the map that comprises a set of 2D pictures: one picture for the ground level and one picture for the other elements of the scene. The generated map may then be rendered on an augmented reality device. The ground and the non-ground content may be rendered independently, then additional elements, such as other users of the augmented reality scene or virtual objects, are localized and represented in the map in real-time using a proxy. The rendering can be adapted to the user poses and to the devices themselves.

Abstract: A method, apparatus and system for facilitating navigation toward a region of interest in an extended scene of video content include determining a timeline including information regarding at least one region of interest in the video content and displaying, in a portion of the video content currently being displayed, a visual indicator indicating a direction in which to move in the video content to cause the display of the at least one region of interest. In one embodiment of the present principles a timeline is attached to the content and carries information evolving over time about the region(s) of interest. A renderer processes the timeline and provides navigation information to a user using available means such as a graphical representation or haptic information, or a combination of several means.

Abstract: A method, apparatus and system for facilitating navigation toward a region of interest in an extended scene of video content include determining a timeline including information regarding at least one region of interest in the video content and displaying, in a portion of the video content currently being displayed, a visual indicator indicating a direction in which to move in the video content to cause the display of the at least one region of interest. In one embodiment of the present principles a timeline is attached to the content and carries information evolving over time about the region(s) of interest. A renderer processes the timeline and provides navigation information to a user using available means such as a graphical representation or haptic information, or a combination of several means.

Abstract: According to embodiments, a (e.g., plurality of) lighting model(s) may be computed from a scene model by a processing device. The model (e.g., a geometric model of the scene complemented by a lighting model(s)) may be stored, for example on the processing device. The processing device may be coupled with a user interface running on any of the processing device or another (e.g., Tenderer) device. According to embodiments, a (e.g., specific) scene, for example, among a set of possible scenes, may be selected via the user interface, for being rendered by the AR application on any of the processing device and a (e.g., different) Tenderer device. According to embodiments, a (e.g., specific, virtual) outdoor lighting condition may be selected via the user interface, and a rendering of the selected scene may be adapted by the AR application according to the selected outdoor lighting condition.

Abstract: Localization of a user device in a mixed reality environment in which the user device obtains at least one keyframe from a server, which can reside on the user device, displays at least one of the keyframes on a screen, captures by a camera an image of the environment, and obtains a localization result based on at least one feature of at least one keyframe and the image.

Abstract: A method and apparatus is provided for enhancing immersive experiences. The progress of a virtual reality content provided in mixed reality environment is monitored. The mixed reality environment incorporates virtual reality content with images provided from a real environment. In addition, at least one virtual acoustic data associated with the virtual reality content is obtained and modified by incorporating said images provided in the real environment.

Abstract: A method for rendering a non-photorealistic (NPR) content from a set (SI) of at least one image of a same scene is provided. The set of images (SI) is associated with a depth image comprising a set of regions. Each region corresponds to a region of a given depth. The method for rendering a non-photorealistic content includes generation of a segmented image having at least one segmented region generated with a given segmentation scale. The at least one segmented region corresponds to at least one region of the set of regions. A binary edge image is generated in which at least one binary edge region is generated with a given edge extraction scale, the at least one binary edge region corresponding to at least one region of the set of regions. The non-photorealistic content is rendered by combining the segmented image and the binary edge image.

Abstract: A method of selection of an object in an environment including a plurality of real and/or virtual objects is described. The environment being displayed to a user through a display device includes an assignment of a gesture path to each object of the plurality of objects and the gesture path includes a series of gestures to be performed by the user to select the object.

Abstract: An augmented reality (AR) interactive system and method is provided. In one embodiment the systems comprises a head mounted user interface configured to receive user input, a processor configured to manage data based on user input, a camera and a display. The camera and the display are in processing communication with one another and the head mounted user interface via the processor. The processor is configured to determine a user's field of view and a center of the user's field of view based on output of a sensor and rendering images for output to the display. Each of the images include one or more objects and a plurality of signs each corresponding to a selectable object in the user's field of view. The rendering of images include altering a first display attribute of a given sign of the plurality of displayed signs based on determining that the user's field of view is centered on the given sign.

Abstract: A device and method is provided for establishing via a processor a common interacting area. The common interacting area is based on the intersection of field of view of a first user device and a second user device. The processor also establishes a border area inside the common interacting area. Any image appearing within the common interacting area that has any portion of it falling within the border area is modified by the processor. The image itself includes a real component and a computer generated component. A system, user interface and method is provided for.

Abstract: A method for authenticating a user in which a processor receives user input representing selected authentication elements among authentication elements presented to a user and triggers failure of user authentication or validates user authentication responsive to received authentication elements using at least one user interface authentication set is described. At least one mandatory authentication element is required to be selected by a user for successful user authentication and at least one failure authentication element for triggering failure of user authentication when selected by a user. The at least one authentication element corresponds to a time location in a media content.

Abstract: An apparatus and a method for controlling the same by a user are suggested. The suggested apparatus comprises: a detecting unit for detecting a first event executed by a user in relation to a plurality of devices including the apparatus; a control unit for generating a second event according to the first event detected by the detecting unit; an output unit for presenting the second event to the user, wherein the control unit generates a command for executing the first event on the apparatus as a function of a response of the user to the second event detected by the detecting unit. The suggested apparatus and method are suitable to provide a second event, before executing a command corresponding to a first event from the user, for the user to confirm the intention of the first event.

Abstract: The present disclosure relates to a new method to make a 3D acquisition of the video scene and to replace an object of the video scene by a substitute object corresponding to the product having substantially common 3D features than the object to be replaced and acceptable criteria values. It permits to minimize the appearance of hidden surfaces or occlusions.

Abstract: An augmented reality (AR) interactive system and method is provided. In one embodiment the systems comprises a head mounted user interface configured to receive user input, a processor configured to manage data based on user input, a camera and a display. The camera and the display are in processing communication with one another and the head mounted user interface via the processor. The processor is configured to determine a user's field of view and a center of the user's field of view based on output of a sensor and rendering images for output to the display. Each of the images include one or more objects and a plurality of signs each corresponding to a selectable object in the user's field of view. The rendering of images include altering a first display attribute of a given sign of the plurality of displayed signs based on determining that the user's field of view is centered on the given sign.

Abstract: A method, apparatus and system for facilitating navigation toward a region of interest in an extended scene of video content include determining a timeline including information regarding at least one region of interest in the video content and displaying, in a portion of the video content currently being displayed, a visual indicator indicating a direction in which to move in the video content to cause the display of the at least one region of interest. In one embodiment of the present principles a timeline is attached to the content and carries information evolving over time about the region(s) of interest. A renderer processes the timeline and provides navigation information to a user using available means such as a graphical representation or haptic information, or a combination of several means.

Abstract: In a method for consistently editing stereographs in warping at least part of a virtual 3D scene, a set of positional constraints is associated with a source and a target position of at least one constraint point in at least one specified depth layer of each of two specified stereographic images. The source and target positions in both images are respectively associated with semantic source and target point in the 3D scene. Those images are warped by applying these positional constraints for each of the specified depth layer and a warped stereograph is generated, comprising the two warped images for the specified depth layer.

Abstract: A method is proposed for 3D reconstruction of an environment of a mobile device comprising a camera. The method includes calculating a coarse 3D reconstruction of at least one of the environment by a first reconstruction method that takes into account first pictures of the at least one area captured by the camera, determining if at least one target part exists in the environment based on a detection of at least one object attribute taking into account at least one of the first pictures, calculating a refined 3D reconstruction of the at least one target part by a second reconstruction method that takes into account second pictures of the at least one target part captured by the camera, and aggregating the calculated reconstructions for providing the 3D reconstructionof the environment.

Abstract: A method of selection of an object in an environment including a plurality of real and/or virtual objects is described. The environment being displayed to a user through a display device includes an assignment of a gesture path to each object of the plurality of objects and the gesture path includes a series of gestures to be performed by the user to select the object.