Abstract: A virtual presence merged reality system comprises a server comprising at least one processor and memory including a data store storing a persistent virtual world system comprising one or more virtual replicas of real world elements. The virtual replicas provide self-computing capabilities and autonomous behavior. The persistent virtual world system comprises a virtual replica of a physical location hosting a live event, wherein the persistent virtual world system is configured to communicate through a network with a plurality of connected devices that include sensing mechanisms configured to capture real-world data of the live event that enables updating the persistent virtual world system. The system enables guests to virtually visit, interact and make transactions within the live event through the persistent virtual world system. Computer-implemented methods thereof are also provided.

Abstract: A merged reality system comprises servers in a cloud to edge infrastructure configured to store and process data and models of virtual replicas of real world elements that provide self-computing capabilities and autonomous behavior to the virtual replicas. The data and models are input through a plurality of software platforms, software engines, and sensors connected to things and user devices. The server is further configured to merge the real and virtual data and models in order to augment the real data with the virtual data. A method thereof comprises mapping the real world into a virtual world, generating virtual replicas of the real world; adding models and data of the virtual replicas; connecting the virtual replicas to corresponding real elements in order to enrich and synchronize the virtual replicas with the real-world elements; merging the real and virtual data; and augmenting the real data with the virtual data.

Abstract: In some embodiments, a communications device is provided that includes a normal internal energy storage configured to supply energy to the communications device during normal operations, and a backup internal energy storage configured to supply energy to the communications device during emergency operations. The communications device is configured to, in response to detecting that a state of charge of the normal internal energy storage has reached a predetermined level, switch from the normal operations mode to the emergency operations mode and switch from consuming power from the normal internal energy storage to consuming power from the backup internal energy storage.

Abstract: A device is disclosed which comprises a media interface configured to provide a plurality of media streams, each media stream being captured using a camera of at least one array of cameras, an input interface configured to receive a device position associated with an output device, and a processor configured to generate from the plurality of media streams an output stream adjusted to the device position.

Abstract: An accurate and flexible merged reality system and method configured to enable remotely viewing and participating in real or virtual events. In the merged reality system, at least one portion of the real or a virtual world may be respectively replicated or streamed into corresponding sub-universes comprised within the virtual world system, wherein some of the sub-universes comprise events that guests may view and interact with from one or more associated guest physical locations. Other virtual elements, such as purely virtual objects or graphical representations of applications and games, can also be included in the virtual world system. The virtual objects comprise logic, virtual data and models that provide self-computing capabilities and autonomous behavior. The system enables guests to virtually visit, interact and make transactions within the event through the virtual world system.

Abstract: A method for inviting users to participate in activities comprises receiving from a first client device a recording of at least a part of an activity provided via the first client device to a first user and one or more parameters related to a configuration of the activity on the first client device, embedding an interactive element into the recording of the activity, thereby generating an invitation to participate in the activity, wherein the invitation is published. The method further comprises receiving from a second client device an indication of an interaction of a second user with the embedded interactive element, and providing the one or more parameters for initiating the activity on the second client device according to the configuration. Furthermore, a system enabling inviting of users to participate in activities and a corresponding client device are defined.

Abstract: A system and method for recording and broadcasting motion of a sports ball and individual players includes a sports ball with cameras embedded within for recording trajectory and locomotion, a sensor module for storing video footage and telemetry metadata, and cameras mounted on the sports equipment of individual players. The sensor module includes an Inertia Measuring Unit, a transceiver, a memory, a power source, and a processor, all operatively connected to one another. The sports ball sends data to a wireless data transmission grid mounted under a sports pitch and/or to antennas for transfer to a data processing server which determines a real ball direction thereafter sent to a stadium camera system that generates further 360 degree action-focused broadcasting data. The data is sent to the processing server which processes the raw footage received from the sports ball and individual players to produce clean footage for various applications.

Abstract: A method enabling live management of events in the real world through a persistent virtual world system comprises providing in the memory of a server a database with structured data storing a persistent virtual world system comprising virtual replicas of real-world elements; synchronizing the virtual replicas with the respective real-world elements by using a plurality of connected elements connected to the server via a network, the connected elements comprising sensing mechanisms configured to capture data from the real-world elements; and managing events in the real world through the synchronized persistent virtual world system. Management of events comprises monitoring activity in the real world through a persistent virtual world system; detecting the events; checking whether events fall within one or more predetermined analysis requirement parameters; defining timeframe of events; storing the events in the memory; recreating the events; and analyzing the events.

Abstract: A method for providing aircraft network communications is provided. The method includes checking, by an onboard server of an aircraft, for aircraft network connection readiness; receiving, by the onboard server, a connection request from one or more user devices on the aircraft that subsequently and periodically continue scanning for aircraft network connection readiness; in response to finding, by the onboard server, a secure connection to an aircraft communications network based on one or more connection rules, connecting the onboard server to the aircraft communications network; notifying the one or more user devices that a network is available; authenticating the one or more user devices; connecting the one or more user devices to the aircraft network; monitoring network connection status; and in response to determining that the network connection status is insecure based on the one or more connection rules, disconnecting the onboard server from the aircraft communications network.

Abstract: A system and method enabling two-way interactive operations of real-time 3D virtual replicas and real objects are described. The system includes a persistent virtual world system comprising a data structure in which at least one real-time 3D virtual replica of a real object is represented, which is stored and computed on a server; at least one corresponding real objects connected to the real-time 3D virtual replica via a network through the persistent virtual world system stored and computed on the server: and at least one user device connected to the real object via the network through the virtual world system stored and computed on the server. Virtually selecting and thereafter effecting changes on the real-time 3D virtual replica results in a real-time corresponding effect on the real object. Likewise, effecting one or more changes on the real object results in a real-time corresponding effect on the real-time 3D virtual replica.

Abstract: Systems and methods are provided for enabling optimized real-time responsive and continuous location-based services in three-dimensional space, including cloud computing, rendering, tracking, and communication through a distributed computing center network. The system includes distributed computing centers connected to data centers, wherein each computing center further comprises one or more cloud servers configured with computing resources sufficient to perform computing and rendering for one or more client devices, and wherein each data center further comprises one or more master servers with computing resources sufficient to perform application and user data storage, synchronization of digital reality data sent by cloud servers, and dynamic network slicing and quality of service management. Instructions to perform these methods are implemented in a digital reality virtual radio access network portion in cloud servers.

Abstract: A method to generate a collaborative 3D map comprises providing a 3D map data fusion platform; providing a basic satellite map of a world location; publishing a detailed real-time virtual replica network (RVRN) of a real world place with reference to the basic satellite map; obtaining the pose (e.g., position and orientation) of a client device; and performing a simultaneous location and mapping (SLAM) process of a first coordinate space. The SLAM process uses image data from an imaging device of the client device, the pose of the client device, and/or the data of the basic satellite map to determine the pose of a plurality of features within the first coordinate space. The method further includes creating a new map comprising three-dimensional coordinates of the plurality of features within the first coordinate space and merging the new map with the published RVRN, creating a fused 3D map.

Abstract: A system enabling a distributed 3D engine for performing dynamic load balancing through virtual worlds are provided. The system comprises one or more server computers comprising memory and at least one processor, the memory storing a data structure representing at least one portion of a virtual or real world as a plurality of cells storing virtual objects. The memory further stores a distributed 3D engine comprising a resource manager implemented in a distributed deployment and a plurality of individual software engines. Resources are dynamically allocated via the distributed deployment to one or more cells based on a current load and a corresponding computed and ranked demand. In some embodiments, the demand further considers one or more of an amount of virtual objects and level of interactions within the portion of the persistent virtual world system visible to a user avatar. Methods thereof are also provided.

Abstract: Systems and methods for optimizing virtual world computations through an n-tier architecture including at least three tiers are provided. In a sample three-tier architecture, a first tier comprises a client software engine configured to receive input data, send the data to the second tier, and perform end-user processing. A second tier connects to the first tier and to a third tier through a network and comprises a client-dedicated module that is dynamically instantiated and which is configured to either prepare the received data for subsequent processing from the client software engine or send the received data to the third tier. The third tier comprises a virtual world processing module configured to receive and process data from the second tier, generating world state updates, and to dynamically instantiate the client-dedicated module to spawn client-dedicated instances. The world state updates are sent to corresponding client-dedicated module instances for further processing.

Abstract: A cross-lingual voice conversion system and method comprises a voice feature extractor configured to receive a first voice audio segment in a first language and a second voice audio segment in a second language, and extract, respectively, audio features comprising first-voice, speaker-dependent acoustic features and second-voice, speaker-independent linguistic features. One or more generators are configured to receive extracted features, and produce therefrom a third voice candidate keeping the first-voice, speaker-dependent acoustic features and the second-voice, speaker-independent linguistic features, wherein the third voice candidate speaks the second language. One or more discriminators are configured to compare the third voice candidate with the ground truth data, and provide results of the comparison back to the generator for refining the third voice candidate.

Abstract: A method for enabling the enhanced user-to-user communication in digital realities comprising generating a marker of a target user that is persistently applied on the target user; detecting, through a wireless network, the presence of a target user device and counterpart user device connected to the server via the wireless network; sending a notification to the counterpart user device informing about the presence of the target user device based on a set of rules; receiving one or more forms of interaction from the counterpart user device on the marker of the target user; opening up a communication channel between the counterpart user device and target user device; and receiving, processing and accordingly redirecting corresponding communications through and between the counterpart user device and target user device. A system thereof is also disclosed.

Abstract: Systems and methods are described for immersive remote participation in live events hosted by interactive environments and experienced by users in immersive realities.

Abstract: A spatially-aware multimedia router system includes at least one media server computer configured to receive and analyze incoming data comprising incoming multimedia streams from client devices, and adapt outbound multimedia streams for individual client devices based on the incoming data received from the client devices. The incoming multimedia streams include elements from within a virtual environment. The outbound multimedia streams are adapted for the individual client devices based on user priority data and spatial orientation data that describes spatial relationships between corresponding user graphical representations and sources of the incoming multimedia streams within the virtual environment.

Abstract: A system and method for facilitating tracking of interactions with a plurality of content types within a digital reality. One or more users enter a public digital zone where content from one or more holographic applications is available for interaction through digital reality devices. Interactions include seeing, looking at, clicking on, engaging with, and immersing into the digital content from the one or more holographic applications. Potential outputs of these interactions include transactions, switching to other holographic applications, or completely exiting the holographic application. Each of these interactions is continuously tracked by a telemetry and tracking cloud server communicatively connected to a cloud server and holographic application. Cloud servers of each public digital zone connect to cloud servers of other public digital zones, enabling users to seamlessly access holographic applications located in other public digital zones.

Abstract: Systems and methods are provided for enabling optimized real-time responsive and continuous location-based services in three-dimensional space, including cloud computing, rendering, tracking, and communication through a distributed computing center network. The system includes distributed computing centers connected to data centers, wherein each computing center further comprises one or more cloud servers configured with computing resources sufficient to perform computing and rendering for one or more client devices, and wherein each data center further comprises one or more master servers with computing resources sufficient to perform application and user data storage, synchronization of digital reality data sent by cloud servers, and dynamic network slicing and quality of service management. Instructions to perform these methods are implemented in a digital reality virtual radio access network portion in cloud servers.