Abstract: Disclosed herein are methods and systems for an intelligent, interactive, and augmented reality (AR) cloud platform. The platform can be implemented in many applications, such as providing real-time intelligent and interactive control between user input data and the resulting AR data, providing real-time and effective AR-based communication, or providing real-time control of physical devices in a remote network.

Abstract: Described is an intelligent real-time multiplayer content management and data analytics system for AR-based social platforms. The data management system described herein manages AR content and multiple user interactions with the AR content. Additionally, a new multiplayer multiple-stage information augmentation design based on real-time data analysis and live AR interaction is described. In this design, AR content design is very flexible and may be organized into one or more stages containing pre-defined content, on-line searched content, user-generated content, other user-generated content, real-time user interactively generated content, or some combination. The flexible content structure allows for a highly customizable AR social experience to maximize the system performance and user experience.

Abstract: Disclosed herein are methods and systems for intelligent and personalized advertisement in an augmented reality environment. In particular, a plurality of integrated images of an extracted real-life object in a virtual environment is provided at a server to a user. The plurality of integrated images comprises one or more advertisement elements that are determined using a comprehensive content matching mechanism. The comprehensive content matching mechanism is based on a plurality of factors intelligently determined and personalized comprising advertisement content, user preference information, and context information.

Abstract: Systems, remote servers, devices, and methods for an intelligent augmented reality (IAR) platform-based communications are disclosed. During a communication, real-time audio, video and/or sensor data are captured in real-time; and scene analysis and data analytics are also performed in real-time to extract information from raw data. The extracted information can be further analyzed to provide knowledge. Real-time AR data can be generated by integrating the raw data, AR input data, information input, and knowledge input, based on one or more criteria comprising a user preference, a system setting, an integration parameter, a characteristic of an object or a scene of the raw data, an interactive user control, or a combination thereof. In some embodiments, information and knowledge can be obtained by incorporating Big Data in the analysis.

Abstract: Described is an intelligent real-time multiplayer content management and data analytics system for AR-based social platforms. The data management system described herein manages AR content and multiple user interactions with the AR content. Additionally, a new multiplayer multiple-stage information augmentation design based on real-time data analysis and live AR interaction is described. In this design, AR content design is very flexible and may be organized into one or more stages containing pre-defined content, on-line searched content, user-generated content, other user-generated content, real-time user interactively generated content, or some combination. The flexible content structure allows for a highly customizable AR social experience to maximize the system performance and user experience.

Abstract: Disclosed herein are methods and systems for intelligent and personalized advertisement in an augmented reality environment. In particular, a plurality of integrated images of an extracted real-life object in a virtual environment is provided at a server to a user. The plurality of integrated images comprises one or more advertisement elements that are determined using a comprehensive content matching mechanism. The comprehensive content matching mechanism is based on a plurality of factors intelligently determined and personalized comprising advertisement content, user preference information, and context information.

Abstract: Existing search methods/systems are often generic, offer no user specific information, and do not integrate search query information from multiple users. But multiple users may need to collaborate using interactive AR/VR/MR/Holographic AR/XR to accomplish some task together. A search engine that only works for one user input or treats one user's search as independent from other users would not work for this purpose. Disclosed herein are methods and systems for providing personalized, interactive, and intelligent search information based on user input from one or more users. The search functionality according to the present disclosure is not limited to finding the information and presenting the info as is to the users. Rather, the present disclosure provides for a comprehensive intelligent process that provides useful info to one or more users.

Abstract: Disclosed herein are methods and systems for an intelligent, interactive, and augmented reality (AR) based user interface platform. The platform can be implemented in many applications, such as providing real-time intelligent and interactive control between user input data and the resulting AR data, providing real-time and effective AR-based communication, or providing real-time control of physical devices in a remote network.

Abstract: Existing search methods/systems are often generic and sometimes offer no user specific information. Disclosed herein are methods and systems for providing personalized, interactive, and intelligent search information. In particular, a search query is provided to a remote server and the remote server uses intelligent analysis for better interpreting and understanding user input and interactive user feedback concerning both search query quality and search result quality are provided to improve search quality and user experience, especially for accurate and intelligent searches in an interactive system (e.g., in an AR system). Using a remote server for query processing is advantageous because of its superior capability, including superior computing capacity.

Abstract: Disclosed herein are methods and systems for real-time content-matched advertisement in an augmented reality environment. In particular, a plurality of integrated images of an extracted real life object in a virtual environment is provided at a computer device to a user. The plurality of integrated images comprises one or more advertisement elements that are determined using a comprehensive content matching mechanism. The comprehensive content matching mechanism is based on a plurality of factors comprising advertisement content, user preference information, and context information.

Abstract: Described is a real-time content management and data analytics system for AR-based platforms. The data management system described herein manages AR content and user interactions with the AR content. Additionally, a new multiple-stage information augmentation design based on real-time data analysis and live AR interaction is described. In this design, AR content design is very flexible and may be organized into one or more stages containing pre-defined content, on-line searched content, user generated content, other user generated content, real-time user interactively generated content, or some combination. The flexibility content structure brings allows for a high customizable AR experience for each user to maximize user relevance and stickiness. An example application of the system described herein is for interactive advertisements.

Abstract: Systems, remote servers, devices, and methods for an intelligent augmented reality (IAR) platform-based communications are disclosed. During a communication, real-time audio, video and/or sensor data are captured in real-time; and scene analysis and data analytics are also performed in real-time to extract information from raw data. The extracted information can be further analyzed to provide knowledge. Real-time AR data can be generated by integrating the raw data, AR input data, information input, and knowledge input, based on one or more criteria comprising a user preference, a system setting, an integration parameter, a characteristic of an object or a scene of the raw data, an interactive user control, or a combination thereof. In some embodiments, information and knowledge can be obtained by incorporating Big Data in the analysis.

Abstract: Existing search methods/systems are often generic and sometimes offer no user specific information. Disclosed herein are methods and systems for providing personalized, interactive, and intelligent search information. In particular, a search query is provided to a remote server and the remote server uses intelligent analysis for better interpreting and understanding user input and interactive user feedback concerning both search query quality and search result quality are provided to improve search quality and user experience, especially for accurate and intelligent searches in an interactive system (e.g., in an AR system). Using a remote server for query processing is advantageous because of its superior capability, including superior computing capacity.

Abstract: Systems, devices and methods for an intelligent augmented reality (IAR) platform-based communications are disclosed. During a communication, real-time audio, video and/or sensor data are captured in real-time; and scene analysis and data analytics are also performed in real-time to extract information from raw data. The extracted information can be further analyzed to provide knowledge. Real-time AR data can be generated by integrating the raw data, AR input data, information input, and knowledge input, based on one or more criteria comprising a user preference, a system setting, an integration parameter, a characteristic of an object or a scene of the raw data, an interactive user control, or a combination thereof. In some embodiments, information and knowledge can be obtained by incorporating Big Data in the analysis.

Abstract: Existing search methods/systems are often generic and sometimes offer no user specific information. Disclosed herein are methods and systems for providing personalized, interactive, and intelligent search information. In particular, intelligent analysis for better interpreting and understanding user input and interactive user feedback concerning both search query quality and search result quality are provided to improve search quality and user experience, especially for accurate and intelligent searches in an interactive system (e.g., in an AR system).

Abstract: Disclosed herein are methods and systems for real-time image and signal processing in an augmented reality environment; for example, for video conferencing in a virtual environment of the participants' choice. In particular, image information of a real life object is extracted by separating the object from its actual environment in one or more images that are captured in real-time using a comprehensive characteristic-based mechanism. The extracted real life object is then integrated with a virtual environment based on image relations between each pixel of the image information of the real life object and a corresponding pixel of each image of the plurality of images of the virtual environment through a pixel-by-pixel integration approach. The image relations comprise at least a depth relation or a transparency relation.

Abstract: Disclosed herein are methods and systems for real-time holographic augmented reality image processing. The processing includes the steps of receiving, at a computer device and from an image capturing component, real-time image data; extracting one or more objects or a scene from the real-time image data based on results from real-time adaptive learning and one or more object/scene extraction parameters; extracting one or more human objects from the real-time image data based on results from real-time adaptive human learning and one or more human extraction parameters, receiving augmented reality (AR) input data; and creating holographic AR image data by projecting, for each image, the extracted object or scene, the extracted human object, and the AR input data using a multi-layered mechanism based on projection parameters. The real-time adaptive learning comprises object learning, object recognition, object segmentation, scene learning, scene recognition, scene segmentation, or a combination thereof.

Abstract: Described is a real-time content management and data analytics system for AR-based platforms. The data management system described herein manages AR content and user interactions with the AR content. Additionally, a new multiple-stage information augmentation design based on real-time data analysis and live AR interaction is described. In this design, AR content design is very flexible and may be organized into one or more stages containing pre-defined content, on-line searched content, user generated content, other user generated content, real-time user interactively generated content, or some combination. The flexibility content structure brings allows for a high customizable AR experience for each user to maximize user relevance and stickiness. An example application of the system described herein is for interactive advertisements.

Abstract: Disclosed herein are methods and systems for an intelligent, interactive, and augmented reality (AR) based user interface platform. The platform can be implemented in many applications, such as providing real-time intelligent and interactive control between user input data and the resulting AR data, providing real-time and effective AR-based communication, or providing real-time control of physical devices in a remote network.

Abstract: Systems, devices and methods for an intelligent augmented reality (IAR) platform-based communications are disclosed. During a communication, real-time audio, video and/or sensor data are captured in real-time; and scene analysis and data analytics are also performed in real-time to extract information from raw data. The extracted information can be further analyzed to provide knowledge. Real-time AR data can be generated by integrating the raw data, AR input data, information input, and knowledge input, based on one or more criteria comprising a user preference, a system setting, an integration parameter, a characteristic of an object or a scene of the raw data, an interactive user control, or a combination thereof. In some embodiments, information and knowledge can be obtained by incorporating Big Data in the analysis.