Abstract: Apparatuses, methods, and computer programs are disclosed to implement video-based cloud compression model to world signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide first signaling information comprising information related to a world domain, wherein the world domain is a point cloud frame that is represented by a number of points in a first volumetric coordinate system; and provide second signaling information comprising information related to a conversion of a model domain to the world domain, wherein the model domain represents the point cloud frame by a number of points in a second volumetric coordinate system.

Abstract: A method, apparatus, and computer program product provide for compression of volumetric video in a manner that is more efficient and requires less metadata updates. A method can include converting a volumetric video scene into a canonical representation comprising a plurality of frames comprising a video atlas and corresponding metadata. Each frame can be divided into a plurality of tiles based on different tile characteristics, which can be used to analyze and characterize the different tiles for atlas packing purposes. Tiles can be clipped or merged or otherwise edited in the atlas. Tiles can be decomposed to metadata suitable for later rendering of the tile. Tiles having a similar enough color attribute or depth attribute during the entire group of photos can be rendered as a single instance, clipped entirely, and rendered based upon a reference tile and the stored metadata.

Abstract: The invention relates to a video streaming method, comprising receiving a panoramic video; receiving head-tracking data; determining a current field of view based on the head-tracking data. The resolution of the panoramic video may be adjusted based on the current field of view, wherein resolution of the current field of view is a first resolution and the resolution outside of the current field of view is a second resolution. The panoramic video with adjusted resolution may be provided, wherein the first resolution is higher than the second resolution.

Abstract: The invention relates to a method and technical equipment for implementing the method. The method comprises generating a three-dimensional segment of a scene of a content; generating more than one two-dimensional views of the three-dimensional segment, each two-dimensional view representing a virtual camera view; generating multi-view streams by encoding each of the two-dimensional views; encoding parameters of a virtual camera to the respective stream of the multi-view stream; receiving a selection of one or more streams of the multi-view stream; and streaming only the selected one or more streams.

Abstract: A method including receiving information indicative of a first light preference profile, receiving information indicative of a second light preference profile, determining that the first light preference profile differs from the second light preference profile, determining a first light control setting based on the first light preference profile, determining a second light control setting based on the second light preference profile, determining a periodic light source actuation directive, causing sending of the periodic light source actuation directive to the light source, determining a first shutter control directive for the first near eye apparatus, causing sending of the first shutter control directive to the first near eye apparatus, determining a second shutter control directive for the second near eye apparatus, and causing sending of the second shutter control directive to the second near eye apparatus is disclosed.

Abstract: An approach is provided for accurate processing and registering of media content for rendering in 3D maps and other applications. The approach includes determining at least one first pixel of at least one image that geometrically corresponds to at least one second pixel of at least one rendered three-dimensional map. Further, the approach includes processing and/or facilitating a processing of (a) the at least one first pixel; (b) the at least one second pixel; (c) metadata associated with at least one of the at least one first pixel and the second pixel; or (d) a combination thereof to determine at least one confidence value, wherein the at least one confidence value is indicative of an estimated level of geometric distortion resulting from projecting the at least one first pixel onto the at least one second pixel.

Abstract: An augmented reality method for displaying information comprises: capturing a sequence of image frames by a camera of a portable device, obtaining movement data by using an inertial sensor of the portable device, determining a sampling frame rate according to the movement data, selecting a tracking image from the captured image frames according to the sampling frame rate, determining a position of the portable device by comparing the tracking image with a point cloud, and displaying information on a display of the device based on the determined position.

Abstract: There are disclosed various methods and apparatuses for calibration of a multi-camera system. In some embodiments of the method a first image captured by a first camera unit of a multi-camera system and a second image captured by a second camera unit of the multi-camera system are obtained. A two-dimensional optical flow between the first camera unit and the second camera unit is determined by using the first image and the second image. The two-dimensional optical flow is converted into a three-dimensional rotation. A parallax component of the three-dimensional rotation is removed by using extrinsic parameters of the first camera unit and the second camera unit. The modified three-dimensional rotations are used to obtain a first error estimate for the first camera unit and a second error estimate for the second camera unit. In some embodiments the apparatus comprises means for implementing the method.

Abstract: A method comprising: processing a recording of a scene to recognise a predetermined user command event performed within the scene; and automatically controlling image processing of a captured image of the scene to adapt the captured image, in dependence on said recognition of the predetermined user command event performed within the scene.

Abstract: A method and technical equipment are provided. The method comprises receiving media content comprising images and depth information; generating a sparse voxel octree from the received images and depth information; projecting the received image colors to each voxel of the generated sparse voxel octree based on visibility; converting the received images into a set of radiance samples for each voxel of the generated sparse voxel octree; and processing the radiance samples by performing one of the following: fitting the radiance samples to a parametric color model to generate estimated radiance samples for a current viewing direction; or analyzing the radiance samples with the content of the generated sparse voxel octree to separate an actual surface color and reflectance properties from a reflected lighting.

Abstract: The embodiments relate to a method and to technical equipment for implementing the method. The method includes receiving an image with location information from a client; requesting processed region data from a media server based on the location information, said processed region data including one or more images with the corresponding location information; applying a first process for determining a pose of a device for the received image by means of the processed region data; if the first process fails to result the pose of the device, applying a second process for determining a pose of a device for the received image by means of the processed region data; saving the image with the determined pose of the device to the media server; providing the image and the pose of the device to a client for client rendering.

Abstract: The invention relates to a method and a system for image-based retrieval. The method comprises receiving a query image; processing the query image to obtain visual features; determining a feature from the obtained visual features; determining a viewing direction for the query image from a pre-determined set of viewing directions; generating a direction-based hash based on the determined feature in the query image and the viewing direction; identifying sub-volumes of a point cloud database that match the direction-based hash; and matching the identified sub-volumes against all the query image features to find a match.

Abstract: A method including receipt of information indicative of a first viewer being able to visually perceive at least part of a display and information indicative of a second viewer being able to visually perceive at least part of the display, determination of first viewer private content associated with the first viewer, receipt of information indicative of the second viewer being unable to visually perceive at least part of the display, causation of display of the first viewer private content based, at least in part, on the second viewer being unable to visually perceive at least part of the display, receipt of information indicative of the second viewer being able to visually perceive at least part of the display, and termination of display of the first viewer private content based, at least in part, on the second viewer being able to visually perceive at least part of the display is disclosed.

Abstract: A method including receiving information indicative of a first light preference profile, receiving information indicative of a second light preference profile, determining that the first light preference profile differs from the second light preference profile, determining a first light control setting based on the first light preference profile, determining a second light control setting based on the second light preference profile, determining a periodic light source actuation directive, causing sending of the periodic light source actuation directive to the light source, determining a first shutter control directive for the first near eye apparatus, causing sending of the first shutter control directive to the first near eye apparatus, determining a second shutter control directive for the second near eye apparatus, and causing sending of the second shutter control directive to the second near eye apparatus is disclosed.

Abstract: An augmented reality method for displaying information comprises: capturing a sequence of image frames by a camera of a portable device, obtaining movement data by using an inertial sensor of the portable device, determining a sampling frame rate according to the movement data, selecting a tracking image from the captured image frames according to the sampling frame rate, determining a position of the portable device by comparing the tracking image with a point cloud, and displaying information on a display of the device based on the determined position.

Abstract: The embodiments relate to a method and to technical equipment for implementing the method. The method includes receiving an image with location information from a client; requesting processed region data from a media server based on the location information, said processed region data including one or more images with the corresponding location information; applying a first process for determining a pose of a device for the received image by means of the processed region data; if the first process fails to result the pose of the device, applying a second process for determining a pose of a device for the received image by means of the processed region data; saving the image with the determined pose of the device to the media server; providing the image and the pose of the device to a client for client rendering.

Abstract: An approach is provided for processing and/or facilitating a processing of one or more images to determine camera location information, camera pose information, or a combination thereof associated with at least one camera capturing the one or more images, wherein the camera location information, the camera pose information, or a combination thereof is represented according to a global coordinate system. The approach involves causing, at least in part, an association of the camera location information, the camera pose information, or a combination thereof with the one or more images as meta-data information.

Abstract: An approach is provided for accurate processing and registering of media content for rendering in 3D maps and other applications. The approach includes determining at least one first pixel of at least one image that geometrically corresponds to at least one second pixel of at least one rendered three-dimensional map. Further, the approach includes processing and/or facilitating a processing of (a) the at least one first pixel; (b) the at least one second pixel; (c) metadata associated with at least one of the at least one first pixel and the second pixel; or (d) a combination thereof to determine at least one confidence value, wherein the at least one confidence value is indicative of an estimated level of geometric distortion resulting from projecting the at least one first pixel onto the at least one second pixel.

Abstract: The invention relates to a video streaming method, comprising receiving a panoramic video; receiving head-tracking data; determining a current field of view based on the head-tracking data. The resolution of the panoramic video may be adjusted based on the current field of view, wherein resolution of the current field of view is a first resolution and the resolution outside of the current field of view is a second resolution. The panoramic video with adjusted resolution may be provided, wherein the first resolution is higher than the second resolution.

Abstract: The invention relates to a method and a system for image-based retrieval. The method comprises receiving a query image; processing the query image to obtain visual features; determining a feature from the obtained visual features; determining a viewing direction for the query image from a pre-determined set of viewing directions; generating a direction-based hash based on the determined feature in the query image and the viewing direction; identifying sub-volumes of a point cloud database that match the direction-based hash; and matching the identified sub-volumes against all the query image features to find a match.