Abstract: An apparatus comprising: at least one processor; and at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to: transmit a pose and interactivity stream to a server, the pose and interactivity stream comprising data based on information obtained from at least one sensor; determine a validity of the pose and interactivity stream, the validity comprising at least one criterion for which the data within the pose and interactivity stream is considered valid; signal at least one parameter that defines the validity of the pose and interactivity stream; and signal a current state of the validity of the pose and interactivity stream.

Abstract: A method, apparatus, and computer program product provide for extended margins around a viewport for immersive content. In the context of a method, the method receives panoramic video content and determines at least one motion signal. The method determines a viewport area, margin area, and background area for the panoramic video content based on the at least one motion signal and a quality level for each area. The method causes transmission of a request for updated panoramic video content in accordance with the determined quality levels. The method also receives updated panoramic video content in response to the request and causes rendering of the content for display.

Abstract: A method includes generating a bitstream defining a presentation, the presentation comprising an omnidirectional visual media content and a first visual media component and a second visual media component; indicating in the bitstream a first presentation timeline and a second presentation timeline; and indicating in the bitstream a switching mode with respect to the first presentation timeline associated with the first visual media component, or with respect to the second presentation timeline associated with the second visual media component, the switching mode being indicated dependent on a viewpoint of a user; wherein the switching mode provides an indication of switching to the first visual media component or to the second visual media component, the first visual media component corresponding to content captured from a first omnidirectional camera in a first location, and the second visual media component corresponding to content captured from a second omnidirectional camera in a second location.

Abstract: The embodiments relate to methods for encoding and decoding, and technical equipment for the same. The method for encoding includes obtaining two or more representations of volumetric media content, each of the two or more representations of volumetric media content including multiple media component bitstreams; identifying a relationship between the two or more representations; generating a description file containing a media component description for each media component bitstream; group descriptions grouping the media component descriptions for each media component bitstream; grouping information descriptions providing information on the identified relationship between group descriptions representing representations. The description file is provided to a receiver.

Abstract: The embodiments relate to a method and technical equipment for consumption of omnidirectional visual media content, comprising receiving from a sender a bitstream defining a presentation, the presentation comprising an omnidirectional visual media content; transmitting the presentation on a receiver device; determining a condition when to send viewport orientation information to the sender, wherein the determining is based on at least a distance relating to a moving viewport and a corresponding threshold; when the determined condition is met, generating a packet comprising the viewport orientation information and sending the packet to the sender; and receiving a presentation from the sender to be streamed on the receiver device according to the sent viewport orientation.

Abstract: Feature information is received from a client device and describes extended reality scene(s) in an extended reality (ER) environment at the client device. An ER description is formed in an ER description format corresponding to the feature information and is stored. Some of the stored ER description format is provided in a representational format upon request of the client device or other client devices viewing the one or more ER scenes and assisting the positioning of corresponding client devices in the ER environment. A client device captures environmental visual data and generates feature information, describing ER scene(s) in an extended reality environment at the client device, from the environmental visual data, and sends the generated feature information toward a server. A client device can localize itself in a 3D environment of an ER description, and generate ER anchors and objects, link them, and send them to a server.

Abstract: There is disclosed an apparatus and a method for spatial computing service session description for volumetric XR conversation. In accordance an embodiment the method comprises receiving volumetric video from a plurality of sources, the volumetric video data comprising color images and depth images representing at least a part of a scene; determining which of the plurality of sources belong to a same group; selecting a group identifier for the group; associating the volumetric video with the group identifier indicative of from which group the volumetric video data is received; associating the volumetric video with a source identifier indicative of from which source of the group the volumetric video data is received; associating the color image of the volumetric video with a color data identifier; and associating the depth image of the volumetric video with a depth data identifier.

Abstract: A user equipment, media control unit, media resource function, or another device or function capable of receiving, manipulating, and transmitting data may be configured to: receive an omnidirectional video; determine a viewport of a user equipment; determining a delivery mode; determine a region of the omnidirectional video based, at least partially, on the determined viewport and the determined delivery mode; encode the determined region; packetizing the encoded region; and transmit the packetized region to the user equipment based, at least partially, on the determined delivery mode.

Abstract: An apparatus comprising: at least one processor; and at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to: transmit a pose and interactivity stream to a server, the pose and interactivity stream comprising data based on information obtained from at least one sensor; determine a validity of the pose and interactivity stream, the validity comprising at least one criterion for which the data within the pose and interactivity stream is considered valid; signal at least one parameter that defines the validity of the pose and interactivity stream; and signal a current state of the validity of the pose and interactivity stream.

Abstract: A method, apparatus and computer program product encode, into a media description, a first information item indicative of a first locator for segment metadata for a set of representations. The method, apparatus and computer program product encode, into the media description, one or more representation-specific information items indicative of representation-specific locator for segment media data for one or more representations of the set of representations. The method, apparatus and computer program product cause storage of the media description with the set of representations.

Abstract: The embodiments relate to a method comprising establishing a three-dimensional conversational interaction with one or more receivers; generating a pointcloud relating to a user and capturing audio from one or more audio source; generating conversational scene description comprising at least a first dynamic object describing a virtual space for the three-dimensional conversational interaction, wherein the first dynamic object refers to one or more objects specific to the three-dimensional conversational interaction, wherein said one or more objects comprises at least data relating to transformable pointcloud; audio obtained from said one or more audio source and input obtained from one or more connected devices controlling at least the pointcloud, wherein said objects are linked to each other for seamless manipulation; applying the conversational scene description into a metadata, and transmitting the metadata with the respective audio in realtime to said one or more receivers.

Abstract: A method comprising obtaining a 360-degree video content from a video source; projecting the 360-degree video content onto a 2D image plane; dividing the projected 360-degree video content into a plurality of regions, wherein the regions are partly overlapping and each region covers a region of the 360-degree video content suitable for a viewport presentation; receiving a request for a viewport orientation of the 360-degree video content from a client; and providing the client with an viewport presentation of the region corresponding to the requested viewport orientation.

Abstract: A method, apparatus and computer program product creates a viewpoint position structure for media content. The viewpoint position structure specifies a position of a viewpoint defined in a reference coordinate system and an offset of the reference coordinate system with respect to a geographical reference. The method, apparatus and computer program product cause storage of the viewpoint position structure. An indication may be created as to whether the media content is augmented reality media content. The augmented reality media content may comprise a background that is at least partially transparent. The offset may be determined, within the reference coordinate system, relative to a geomagnetic reference direction, based upon one or more of a viewpoint yaw angle, a viewpoint pitch angle, or a viewpoint roll angle.

Abstract: A method includes generating a bitstream defining a presentation, the presentation comprising an omnidirectional visual media content and a first visual media component and a second visual media component; indicating in the bitstream a first presentation timeline and a second presentation timeline; and indicating in the bitstream a switching mode with respect to the first presentation timeline associated with the first visual media component, or with respect to the second presentation timeline associated with the second visual media component, the switching mode being indicated dependent on a viewpoint of a user; wherein the switching mode provides an indication of switching to the first visual media component or to the second visual media component, the first visual media component corresponding to content captured from a first omnidirectional camera in a first location, and the second visual media component corresponding to content captured from a second omnidirectional camera in a second location.

Abstract: A method, apparatus and computer program product encode, into a media description, a first information item indicative of a first locator for segment metadata for a set of representations. The method, apparatus and computer program product encode, into the media description, one or more representation-specific information items indicative of representation-specific locator for segment media data for one or more representations of the set of representations. The method, apparatus and computer program product cause storage of the media description with the set of representations.

Abstract: The invention relates to a solution wherein a bitstream defining a presentation is generated, the presentation comprising an omnidirectional visual media content and a first visual media component and a second visual media component; indicating in the bitstream a first presentation timeline associated with the first visual media component; indicating in the bitstream a second presentation timeline associated with the second visual media component; indicating in the bitstream a switching mode to a second presentation timeline associated with the second visual media component; and indicating in the bitstream, that the switching mode is with respect to the first presentation timeline or to the second presentation timeline.

Abstract: Feature information is received from a client device and describes extended reality scene(s) in an extended reality (ER) environment at the client device. An ER description is formed in an ER description format corresponding to the feature information and is stored. Some of the stored ER description format is provided in a representational format upon request of the client device or other client devices viewing the one or more ER scenes and assisting the positioning of corresponding client devices in the ER environment. A client device captures environmental visual data and generates feature information, describing ER scene(s) in an extended reality environment at the client device, from the environmental visual data, and sends the generated feature information toward a server. A client device can localize itself in a 3D environment of an ER description, and generate ER anchors and objects, link them, and send them to a server.

Abstract: A user equipment, media control unit, media resource function, or another device or function capable of receiving, manipulating, and transmitting data may be configured to: receive an omnidirectional video; determine a viewport of a user equipment; determining a delivery mode; determine a region of the omnidirectional video based, at least partially, on the determined viewport and the determined delivery mode; encode the determined region; packetizing the encoded region; and transmit the packetized region to the user equipment based, at least partially, on the determined delivery mode.

Abstract: A method, apparatus and computer program products are provided for capturing omnidirectional video with one or more cameras, streaming the video over a network, and rendering the video on a Head Mounted Display (HMD) and more specifically to a method, apparatus, and computer program product for improving the visual quality of viewport-based omnidirectional video streaming. One example method includes selecting a primary viewport, encoding a first representation that covers the primary viewport, and encoding a second representation that provides a gradual picture quality change from a background viewport to the primary viewport.

Abstract: This specification describes a method comprising: in response to detecting a user switching from viewing multidirectional video content to viewing limited viewport video content corresponding to the multidirectional video content or from viewing limited viewport video content corresponding to multidirectional video content to viewing the multidirectional video content: determining transition content for transitioning between a current viewport associated with the content being viewed and a landing viewport associated with the content to be viewed, the transition content being determined based on the current viewport and the landing viewport, wherein the length of the transition content depends on an angular distance between the current viewport and the landing viewport; and outputting the transition content for display.