Abstract: A method and apparatus for controlling lightfield and/or holographic media to be streamed to a client, determining a bandwidth based on a status of a client buffer, splitting the scene of the lightfield and/or holographic media, determining whether the assets are present in the client buffer, mapping the assets to respective ones of the split scenes and to the client buffer, controlling a transmission assets to the client buffer based on the bandwidth, the mapping, and whether one or more of the assets are determined to be present in the client buffer, and controlling the client to reuse at least one of the assets when rendering at least one of the split scenes.

Abstract: Media data of a first scene graph is received. The first scene graph is created based on a first scene graph format. The first scene graph format includes a plurality of description components indicating attributes of the first scene graph. A plurality of metadata identifiers associated with the first scene graph format and a plurality of metadata identifiers associated with a second scene graph format are determined based on a lookup table. The lookup table identifies metadata identifiers associated with the first and second scene graph formats. A plurality of description components of the second scene graph format that indicates the attributes of the first scene graph is determined based on (i) the plurality of description components of the first scene graph format, (ii) the plurality of metadata identifiers associated with the first scene graph format, and (iii) the plurality of metadata identifiers associated with the second scene graph format.

Abstract: A method, computer program, and computer system is provided for streaming immersive media. Content is ingested in a first two-dimension format or a first three-dimensional format, whereby the format references a neural network. The ingested content is converted to a second two-dimensional or a second three-dimensional format based on the referenced neural network. The converted content is streamed to a client end-point, such as a television, a computer, a head-mounted display, a lenticular light field display, a holographic display, an augmented reality display, or a dense light field display.

Abstract: Packaging media for optimizing immersive media distribution of a media steam performed by at least one processor, is provided, including: receiving immersive media data for an immersive presentation; acquiring asset information associated with media assets corresponding to a set of scenes included in the immersive media data for the immersive presentation; analyzing characteristics of the media assets based on the asset information, the characteristics comprising an asset type associated with a respective media asset and a frequency that indicates a number of times the respective media asset is used among the set of scenes included in the immersive presentation; ordering the media assets in a sequence based on the asset type and the frequency associated with each of the media assets; and streaming the immersive media data for the immersive presentation based on the ordered sequence of the media assets.

Abstract: A system and method of split rendering for lightfield or immersive media by using an edge-cloud and peer-to-peer based architecture. The system and method include the use of a combination of cloud-based devices and edge-devices to provide distributed processing in connection with the streaming of media, and in particular lightfield or immersive media, to an end user device. The system and method further include the use of multiple cloud and edge devices to provide parallel streaming of a given media package to an end user device.

Abstract: A digital asset security device, includes an asset capture unit configured to electronically capture a digital asset, a processor configured to digitally sign the captured asset, a memory configured to store a digitally signed asset from the processor, and a hashing module in communication the asset capture unit, the processor, and the memory, and configured to provide a cryptographic hash to one or more of the captured asset and the digitally signed asset.

Abstract: A method performed by a network node connected to one or more additional network nodes, the network node and the one or more additional network nodes forming a cloud. The method including setting a first timer to a first value, the first timer associated with determining whether another network node from the one or more additional network nodes is an active controller in the cloud. The method further includes determining, before the first timer expires, whether a first message that indicates that another network node from the one or more additional network nodes is the active controller is received. The method further includes based on determining the first message is received before the first timer expires, restarting the first timer. The method further includes, based on determining the first message is not received before the first timer expires, assigning one or more tasks to at least one network node.

Abstract: Aspects of the disclosure provide methods and apparatuses for immersive media processing. In some examples, a method of media processing includes receiving a scene based immersive media for playing at a light field based display. The scene based immersive media includes a plurality of scenes. The method includes assigning priority values respectively to the plurality of scenes in the scene based immersive media, and determining an order for streaming the plurality of scenes to an end device according to the priority values. In some examples, a method of media processing includes receiving a scene based immersive media for playing at a light field based display. A scene in the scene based immersive media includes a plurality of assets in a first order. The method includes determining a second order for streaming the plurality of assets to an end device, the second order is different from the first order.

Abstract: Aspects of the disclosure provide methods and apparatuses (electronic devices) for media processing. In some examples, an electronic device includes processing circuitry to perform a process of a smart client that is a client interface of the electronic device to an immersive media streaming network. A method for media processing includes transmitting, by the client interface of the electronic device and to a server device in the immersive media streaming network, capability and availability information of the electronic device for playing back a scene-based immersive media. Further, the method includes receiving, by the client interface, a media stream carrying adapted media content for the scene-based immersive media. The adapted media content is generated from the scene-based immersive media by the server device based on the capability and availability information. The method then includes playing back the scene-based immersive media according to the adapted media content.

Abstract: A method for streaming scene-based media assets during a media streaming session performed by a computing device is provided. The method includes providing a bi-directional interface for communicating information about scene-based media assets between a network server and the computing device acting as a client device; and providing, to the network server via the interface, client device attributes and corresponding information related to availability of client device resources when requested, wherein the client device attributes and the information are used by the computing device for rendering the scene-based media assets. For example, the computing device receives a request from the network server and then determines whether the requested scene-based media assets is to be streamed from the network server or not by accessing a list of locally stored, previously streamed scene-based media assets.

Abstract: A method of streaming immersive media includes receiving, from a client end-point, a video content request that identifies video content; transmitting, to the client end-point based on the video content request, a profile request; receiving, from the client end-point, at least one neural network model associated with one or more characteristics of the client end-point; ingesting the identified video content in a two-dimensional video format; converting the ingested video content to a three-dimensional video format based on the at least one neural network model such that the ingested video content converted to the three-dimensional video format includes at least one scene interpolated from one or more scenes of the ingested video content in the two-dimensional video format; and streaming the converted video content to the client end-point.

Abstract: A method, computer program, and computer system is provided for streaming immersive media. The method includes ingesting content in a two-dimensional format, the 2D format referencing at least one neural network; converting the ingested content to a three-dimensional format based on the referenced at least one neural network; and streaming the converted content to a client end-point.

Abstract: A method including parsing a scene file to extract relevant scene file data; sending the relevant scene file data to a converter; translating, by the converter, the relevant scene file data into a format compatible with a respective rendering engine; mapping the translated scene file data using the respective rendering engine into a scene representation, wherein the scene representation is compatible with an Immersive Technologies Media Format (ITMF).

Abstract: A system and method for split rendering immersive media using proxy edge cloud computing architecture. The system and method may include dynamically determining a task-split or splitting a task for rendering a scene in an immersive media stream into two or more computational tasks based on one or more processing delays, wherein the task-splitting splits the scene into first part including one or more first tasks performed by an edge computing system and second part including one or more second tasks performed by a cloud computing system. The system and method may include transmitting the first parts of the scene, and transmitting the second parts of the scene.

Abstract: A method is performed by a network node connected to one or more additional network nodes via a local area network (LAN). The network node and the one or more additional network nodes form a cloud. The method includes setting a first timer to a first value, the first timer being associated with determining whether one of the one or more additional network nodes is an active controller in the cloud. The method includes starting the first timer. The method includes determining, before the first timer expires, whether a first message that indicates the one of the one or more additional network nodes is the active controller is received. Based on determining the first message is received before the first timer expires, the method includes synchronizing with the one of the one or more additional network nodes that is the active controller, and restarting the first timer.

Abstract: A method performed by a network node connected to one or more additional network nodes, the network node and the one or more additional network nodes forming a cloud. The method including setting a first timer to a first value, the first timer associated with determining whether another network node from the one or more additional network nodes is an active controller in the cloud. The method further includes determining, before the first timer expires, whether a first message that indicates that another network node from the one or more additional network nodes is the active controller is received. The method further includes based on determining the first message is received before the first timer expires, restarting the first timer. The method further includes, based on determining the first message is not received before the first timer expires, assigning one or more tasks to at least one network node.

Abstract: A method for streaming media assets using a redundant cache managed by a media streaming server in a media streaming network may be provided. The method may include receiving, by a media streaming server, immersive media stream comprising one or more immersive media assets associated with one or more scenes, determining that a subset of the one or more immersive media assets are included for a plurality of times in the one or more scenes, storing a redundant copy of each of the subset of the one or more immersive media assets in a cache maintained by the media streaming network to ensure that the each of the subset is accessible to both the media streaming server and a client, and streaming at least one media asset of the subset of the one or more immersive media assets in response to a local cache of the client not storing the at least one media asset.

Abstract: A method and apparatus for determining that a media asset appears in at least two or more scenes in scenes associated with an immersive media presentation, sending a request to a client querying whether the client has access to the media asset appearing in at least two or more scenes in a local cache, receiving a reply indicating whether the client has access, signaling, in response to the reply indicating that the client has access to the media asset appearing in at least two or more scenes in the local cache, the client to use the media asset in a subsequent scene, and distributing the media asset to the client in response to the reply indicating that the client has no access to the media asset appearing in at least two or more scenes in the local cache.

Abstract: A method for packaging media for optimizing media distribution in a media streaming network may be provided. The method may include: receiving, by a media streaming server, an immersive media stream comprising one or more immersive media assets associated with one or more scenes; identifying a subset of the one or more immersive media assets that comprise essential elements of a respective scene; ordering the one or more immersive media assets in a sequence, based on the identified subset of the one or more immersive media assets that comprise essential elements of a respective scene in the one or more scenes; and streaming the one or more immersive media assets in the ordered sequence from the media streaming server to a client device.

Abstract: Analyzing the complexity of an object of a scene in a media steam (or media data) performed by at least one processor, is provided, including receiving immersive media data comprising a plurality of scenes from a content source; obtaining a respective object of a respective scene in the plurality of scenes, from the immersive media data; analyzing the respective scene to generate complexity information associated with the respective object of the respective scene; generating metadata associated with the respective object of the respective scene, the metadata comprising the complexity information; and determining whether to distribute the respective scene to a client for processing based on the generated metadata.