Abstract: A system and method provides a video chat capability where the video portion of the chat is initially impaired, but gets progressively clearer, either as time elapses, or as the users speak or participate with relevant information.

Abstract: A method of changing a virtual world of a computer-implemented game based on real-world locations of players of the computer-implemented game is disclosed. A presence of a player of the computer-implemented game is detected at a physical location. A presence of an additional player of the computer-implemented game is detected at the physical location based on a communication received from the player of the computer-implemented game. An aspect of the virtual world of the computer-implemented game is changed based on the detecting of the presence of the player at the physical location and the detecting of the presence of the additional player of the computer-implemented game at the physical location.

Abstract: The present invention relates to a method for generating and causing display of a communication interface that facilitates the sharing of emotions through the creation of 3D avatars, and more particularly with the creation of such interfaces for displaying 3D avatars for use with mobile devices, cloud based systems and the like.

Abstract: The technology described in this document can be embodied in a computer-implemented method of controlling a wearable audio device configured to provide an audio output. The method includes receiving data indicating the wearable audio device is proximate a geographic location associated with a localized audio message, and determining that the localized audio message has a higher priority compared to at least one other localized audio message associated with another geographical location proximate to the wearable audio device. The method also includes, responsive to determining that the localized audio message has the higher priority, providing a prompt to initiate playback of the localized audio message with the higher priority to a user of the wearable audio device, and initiating playback of the localized audio message with the higher priority at the wearable audio device in response to actuation of the prompt by the user.

Abstract: A HMD includes a sensor for detecting an orientation of a main body, a display, and a field image display unit for displaying a first image in a predetermined first display region of the display and displaying a second image related to the first image in a second display region of the display on a screen of the display. The field image display unit determines the second display region on the screen of the display according to the orientation of the main body.

Abstract: A game processing method executed by an information processing device includes obtaining information on a character object, obtaining information on a clothing object worn by the character object, obtaining information on clothing area including an area exposed from the clothing object, the clothing area being set to skin of the character object, setting drawing setting of the clothing area to first drawing setting for drawing as the skin or to second drawing setting for drawing as clothing, and drawing the character object and the clothing object based on the information on the character object, the information on the clothing object, and the drawing setting.

Abstract: Examples of systems and methods for a wearable system to automatically select or filter available user interface interactions or virtual objects are disclosed. The wearable system can select a group of virtual objects for user interaction based on contextual information associated with the user, the user's environment, physical or virtual objects in the user's environment, or the user's physiological or psychological state.

Abstract: Generation of expressive content is provided. An expressive synthesized speech system provides improved voice authoring user interfaces by which a user is enabled to efficiently author content for generating expressive output. An expressive synthesized speech system provides an expressive keyboard for enabling input of textual content and for selecting expressive operators, such as emoji objects or punctuation objects for applying predetermined prosody attributes or visual effects to the textual content. A voicesetting editor mode enables the user to author and adjust particular prosody attributes associated with the content for composing carefully-crafted synthetic speech. An active listening mode (ALM) is provided, which when selected, a set of ALM effect options are displayed, wherein each option is associated with a particular sound effect and/or visual effect. The user is enabled to rapidly respond with expressive vocal sound effects or visual effects while listening to others speak.

Abstract: Methods and systems are provided for generating auto-complete image suggestions. In embodiments described herein, a user image having an edit state is obtained. An edit state can indicate any edits applied by the user to the user image. For the user image, an auto-complete image suggestion is generated. The auto-complete image suggestion includes a representation of the user image with the user-applied edits as well as a set of supplemental edits. Such supplemental edits can be determined from a pre-edited image identified as similar to the user image.

Abstract: The present disclosure describes systems and methods that apply artificial intelligence to augmented reality for enhanced user experience. A sensor, such as a camera, on a mobile phone can capture output data of a laptop computer or other computing device, such as a user interface. The captured image can be assessed by the mobile phone to determine an intent of a user and to display a three dimensional rendering, such as an avatar, on the mobile phone overlaid on top of the user interface of the laptop. The avatar can help navigate the user, such as pointing to areas of a webpage of interest, or inviting the user to scroll down on a webpage to a portion of the webpage that may not be in current view.

Abstract: Among other things, embodiments of the present disclosure provide systems and methods for modifying avatar components of avatar datasets for multiple users, generating avatars based on the datasets, and displaying multiple avatars on a display screen of a graphical user interface.

Abstract: The present invention is directed to interactive training, and in particular, to methods and systems for computerized interactive skill training. An example embodiment provides a method and system for providing skill training using a computerized system. The computerized system receives a selection of a first training subject. Several related training components can be invoked, such as reading, watching, performing, and/or reviewing components. In addition, a scored challenge session is provided, wherein a training challenge is provided to a user via a terminal, optionally in video form.

Abstract: A method that incorporates the subject disclosure may include, for example, providing a first digital assistant to engage in a first communication exchange with a user of the first communication device where the first digital assistant has a first digital assistant persona that controls information provided by the first digital assistant during communication exchanges, analyzing user input during the first communication exchange, and adjusting the first digital assistant persona based on one or more of the user persona, user deficiency, or promotional offers. Other embodiments are disclosed.

Abstract: An electronic device may include: a camera, a display, a processor operatively coupled to the camera and the display, and a memory operatively coupled to the processor. The memory may store a plurality of avatar templates containing a plurality of gestures and instructions. The instructions, when executed by the processor may control the electronic device to: obtain an image of an external object using the camera, obtain a value of at least one parameter corresponding to an emotion state based on the obtained image, select an avatar template including a first gesture from among the plurality of avatar templates based on the value of the at least one parameter, generate an avatar sticker including a second gesture different from the first gesture based on the selected avatar template and the value of the at least one parameter, and display the generated avatar sticker on at least a portion of the display.

Abstract: An imaging control apparatus includes a setting unit configured to set, in accordance with user operation, whether transparent display at a first transparency level is performed for a display element that is superimposed and displayed on a captured image captured by an imaging unit; a display control unit configured to superimpose and display a plurality of display elements including a specific display element on the captured image, and to control so that in a case where the setting unit sets the transparent display to be performed, the plurality of display elements other than the specific display element are transparently superimposed and displayed on the captured image at the first transparency level, and the specific display element is superimposed and displayed on the captured image at a second transparency level lower than the first transparency level.

Abstract: Disclosed is a system for recording and storing sequences of operations that may be performed on a client device. During a training phase, the system collects information about operations performed by a user or by an automatic application crawling program. Information about operations may include view-structure data about components of a user interface and event data about interactions the user has with the interface components and the outcome of such interactions. The operation data is stored in an operation graph that may represent how specific user interactions with interface components can cause transitions to new view-structures of the same or different applications on the client device. The data stored in the operation graph may be used to construct new sequences of operations for later execution, for example, in response to a user query.

Abstract: A method includes determining, by an assistant executing at one or more processors, a default group of actions that the assistant is configured to execute in response to receiving a particular audible command. The method includes determining, by the assistant, based on the default group of actions and a user profile associated with a particular user, a custom group of actions that the assistant is configured to execute in response to receiving the particular audible command from the particular user. The method also includes receiving, by the assistant, an indication of the particular audible command, and determining, by the assistant, whether the indication of particular audible command originated from the particular user. The method further includes, responsive to determining that the indication of particular audible command originated from the particular user, executing, by the assistant, each action from the custom group of actions.

Abstract: A method and system of providing guidance and information to customers by presentation of a virtual avatar. The virtual avatar is controlled in real-time by a remote customer service agent. The method includes sharing images of a physical space with the customer service agent, and enabling the customer service agent to project a virtual avatar on the physical space such that the virtual avatar appears to interact and move through the physical space. The dynamic projection of the virtual avatar is received by the customer as an augmentation of their own view of the physical space.

Abstract: Method of generating customized avatars based on location information includes processor receiving from first client device location information including a location of the first client device. Processor causes a status interface to be displayed on first client device that includes selectable location items corresponding to locations based on the location information. Processor receives a selection from first client device of first selectable location item and causes avatar selection interface to be displayed on first client device that includes versions of first avatar performing actions related to the first selectable location item. Processor receives selection of first selectable version of the first avatar and generates a map interface that includes a map display based on the location information and the first selectable version of the first avatar. Processor causes the map interface to be displayed on at least one of the plurality of client devices. Other embodiments are disclosed.

Abstract: Among other things, embodiments of the present disclosure provide systems and methods for modifying avatar components of avatar datasets for multiple users, generating avatars based on the datasets, and displaying multiple avatars on a display screen of a graphical user interface.

Abstract: Sentiment-aware management of profile pictures on social media platforms. Embodiments of the invention provide for changing a profile picture of a user of a social network platform. A user submits content for posting to the social network platform. Analysis of electronic text associated with the user post is performed to identify a post sentiment. If the post sentiment differs from a sentiment associated with the profile picture, a candidate replacement profile picture having an associated sentiment that matches the post sentiment more closely relative to the associated sentiment of the profile picture, is identified. The profile picture may be replaced by the candidate profile picture.

Abstract: A server system, the server system including: a memory processor including memory; a communication link, a first program designed to construct a list of end-goals for a software tool, where the memory includes a plurality of prior user interface experience records, and where each of the plurality of prior user interface experience records represent a user interaction with a plurality of user interface screens of the software tool; a second program designed to build a user experience graph based on the plurality of prior user interface experience records, where the construct a list of end-goals for a software tool includes at least one end-goal; and a third program designed to use the list of end-goals to communicate to at least one user of the software tool suggestion notes based on popular paths along the user experience graph leading towards the end-goal to help the at least one user interface with the software tool.

Abstract: Embodiments of the present disclosure provide a method and apparatus for processing information. A method may include: generating voice response information based on voice information sent by a user; generating a phoneme sequence based on the voice response information; generating mouth movement information based on the phoneme sequence, the mouth movement information being used for controlling a mouth movement of a displayed three-dimensional human image when playing the voice response information; and playing the voice response information, and controlling the mouth movement of the three-dimensional human image based on the mouth movement information.

Abstract: A GUI and processor-based method for managing selectable entities such as files and directories. When the number of selectable entities in the GUI is large (e.g. over 50 entities) or if similar operations must be done repeatedly, the user experience can be drastically improved by generating and operating on sets of selectable entities. Users (such as a human user) start by picking a plurality of entities displayed on the GUI and save them in memory as a named selection set. Users operate the GUI to manipulate any such selection sets via various means (such as intersection, union, inversion/negation, or via user defined programs) until a selection set contains only the entities that the user wishes to operate on. The user then directs the GUI to automatically perform any of memory/storage operations and/or network transmission operations upon any files and directories in the selection set as desired.

Abstract: A method of performing video synthesis by a terminal is described. Circuitry of the terminal receives a first operation to trigger capture of first media information and detects at least one of a facial expression change of a user based on a first preset condition or a gesture of the user based on a second preset condition during the capture of the first media information. The circuitry of the terminal sends the detected at least one of the facial expression change or the gesture of the user to a server as key information. The circuitry of the terminal receives second media information that corresponds to the key information from the server and performs video synthesis on the first media information and the second media information.

Abstract: A system, method, and computer-readable medium for modeling and diagnosing a system. System identification information captured by an AR system is used to identify the system and one or more of a model of the components of the system or an overlay of the system is retrieved from a repository or generated based on component identification information or component performance data and sent to the AR system. A composite view of the model or overlay relative to a dynamic image or model of the system allows a technician to visualize the system and components and diagnose the operation of the system without opening the system.

Abstract: A wearable system can comprise a display system configured to present virtual content in a three-dimensional space, a user input device configured to receive a user input, and one or more sensors configured to detect a user's pose. The wearable system can support various user interactions with objects in the user's environment based on contextual information. As an example, the wearable system can adjust the size of an aperture of a virtual cone during a cone cast (e.g., with the user's poses) based on the contextual information. As another example, the wearable system can adjust the amount of movement of virtual objects associated with an actuation of the user input device based on the contextual information.

Abstract: The present invention is an action agent architecture in a scalable multi-service virtual assistant platform that can construct a fluid and dynamic dialogue by assembling responses to end user utterances from two kinds of agents, information agents and action agents. A plurality of information agents obtain at least one information value from a parsed user input and/or contextual data. A plurality of action agents perform one or more actions in response to the parsed user input, the contextual data, and/or an information value obtained from at least one of the information agents. The plurality of action agents are created through a declarative language by specifying one or more triggering conditions, one or more action invocation parameters, one or more information agents as pre-requisites, and one or more responses. A natural language generation (NLG) module renders a response back to the user after the one or more actions are performed.

Abstract: Embodiments describe an approach for generating a sign language translation of an audio portion of a video. Embodiments receive a request for a sign language translation for a selected video and extract audio from the selected video. Additionally, embodiments, convert the extracted audio into text, identify contextual sounds in the audio, and convert the text and the contextual sounds into sign language content. Furthermore, embodiments, generate a sign language video based on the sign language content, and display the sign language video in a separate display window on the selected video.

Abstract: A system for providing a virtual reality system is disclosed. In particular, the system provides a game-simulation hybrid that provides a massive online virtual world and accompanying network based around user profiles, events, activities, challenges, virtual lifestyle, and advertising. The system enables users to actively participate in live events or activities occurring in locations remote from the users by rendering digital versions of the live events or activities via applications executing on the computing devices of the users. The digital versions of the live events may be rendered within the virtual world and the system may enable users to interact in the virtual world in meaningful ways. For example, the system may enable users to communicate with other users during the rendering of the live events or activities, participate in the rendered live events with other users, interact with and purchase various rendered goods and services, among other functionality.

Abstract: An information management method collects log information of one or more home electrical apparatuses corresponding to service providers. Display screen data is generated which indicates a status of the log information. The display screen data includes groups of information which each contain information on an apparatus, a service provider corresponding to the apparatus, and log information output from the apparatus. Provision of the log information of each group is individually selectable. The display screen data is provided via a network to a display terminal that performs access to a server device. Information is received from the display terminal, which indicates that selection on whether or not provision of the log information is performed. Provision of the log information is not performed on the selected group when a determination is made that refusal of provision of the log information on the selected group is performed.

Abstract: An electronic system for a vehicle includes a memory and a control circuitry. The memory stores a three-dimensional (3D) model associated with the vehicle. The 3D model is a trained machine learning (ML) model that is trained using a first set of two-dimensional (2D) images as training data associated with the vehicle. The control circuitry receives a user input to display user-assistive information associated with the vehicle. The control circuitry generates a visual representation that corresponds to at least one of a first view of the vehicle or a second view of a component of the vehicle, based on the stored 3D model. The generated visual representation is different from the first set of 2D images. The control circuitry controls display of the user-assistive information that includes the generated visual representation on a display screen of the vehicle.

Abstract: Disclosed herein is a system for facilitating the generation of a customized response based on a context, in accordance with some embodiments. Accordingly, the system may include a communication device configured for receiving at least one sensor data from at least one sensor associated with at least one user. Further, the system may include a processing device configured for analyzing the at least one sensor data and determining a context based on analyzing. Further, the processing device may be configured for identifying a customized profile associated with the context. Further, the system may include a storage device configured for retrieving the customized profile. Further, the processing device may be configured for generating a customized response based on the at least one sensor data and the customized profile. Further, the system may include a presentation device. Further, the presentation device may be configured to present the customized response.

Abstract: A method comprises a computer-implemented contextual virtual assistant (CVA) analyzing one or of a user corpus and input user information to determine to communicate user information to a primary recipient. In the method, the CVA receives information associated with a recipient context that includes the primary recipient, and can determine from the context information that an ancillary recipient is privy, in the recipient context, to information output by the system. The CVA further determines, in the method, output information, based on the user information, and a recipient context to communicate to the primary recipient. The recipient context, comprises a preferred location of the primary recipient, and preferred time, to communicate the output information. A CVA system includes a user corpus, CVA input and output devices, and processors. The processors can perform the method. A computer program product can include instructions to cause one or more processors to perform the method.

Abstract: Embodiments described herein reduce the probability that a user of a VR environment can nefariously rig a system to positively and/or negatively influence another user's reputation score. Information indicative of a positive or negative interaction between an avatar of a first user and an avatar of a second user is received from a client computing device used by the first user. Further information is received from a client computing device used by a third user of the VR environment, and based thereon, there is a determination whether the positive or negative interaction is corroborated or contradicted. If corroborated, a reputation score associated with the second user is increased or decreased. If contradicted, the reputation score associated with the second user is not adjusted, and the reputation score of the first user may be decreased. Such reputation scores can be accessed and used by a user using a client computing device.

Abstract: An example augmented reality system includes: obtaining information about an instance of a device; recognizing the instance of the device based on the information; selecting a digital twin for the instance of the device, with the digital twin being unique to the instance of the device; and generating augmented reality content based on the digital twin and an actual graphic of the instance of the device.

Abstract: A system provides, based at least in part on predetermined parameters, configuration information, and a group of behavioral agents, a dynamic virtual representation that includes a multi-dimensional puppet having one or more attributes of an individual, where the dynamic virtual representation automatically mimics one or more attributes of the individual in a context, the providing of the dynamic virtual representation that includes the multi-dimensional puppet involves rendering of the multi-dimensional puppet, and the multi-dimensional puppet includes stereopsis information, and has photorealistic movement corresponding to movement behaviors of the individual. Then, the system receives an input corresponding to user spatial manipulation of or interaction with the multi-dimensional puppet.

Abstract: A message reminder system, to perform operations that include: causing display of a presentation of a message addressed to a user, at a first position among a message feed of the user at a client device; receiving a request to open the message from the user of the client device, the request including a timestamp; detecting a trigger event based on at least the timestamp of the request to open the message, the trigger event comprising event attributes; generating a notification to be applied to the presentation of the message, the notification based on at least the event attributes of the trigger event; moving the presentation of the message from the first position among the message feed to a second position among the message feed; and applying the notification to the presentation of the message.

Abstract: A cognitive agent system provides a centralized capability for users to configure and deploy cognitive agents across multiple heterogeneous vendor platforms. The cognitive agent system provides a design environment that allows users to define skills, as well as a new conversation construct that supports more complex interactions with users. The cognitive agent system also includes a deployment environment that allows users to register users and cognitive agents, deploy skills and conversations, and monitor the activity of cognitive agents across multiple vendor platforms. These users may use the cognitive agent system to define skills and conversations once and then deploy the skills and conversations to multiple service endpoints across different vendor platforms. In addition, the cognitive agent system allows user to directly manage cognitive agents that are not specific to any particular vendor.

Abstract: A system and method for providing virtual interpersonal communication that include receiving data associated with one-to-one interpersonal communication between a user and a target individual. The system and method also include determining at least one contextual data point and at least one associated behavioral attribute of the user and the target individual during the one-to-one interpersonal communication. The system and method additionally include analyzing at least one statement spoken by the user to a virtual representation of the target individual and presenting a virtual avatar of the target individual in a manner that replicates the personality of the target individual and communicates with the user based on the at least one contextual data point and the at least one associated behavioral attribute.

Abstract: Systems and techniques for the collection and display of athletic information. Athletic data relating to a single person or group of people is collected at a central location, and subsequently displayed at a desired remote location so that the person or people can review and critique their performance. In addition, athletic data for multiple persons can be collected at a central location, and subsequently displayed to a user at a desired remote location, so that the user can compare his or her athletic activities to others.

Abstract: A customization portal provides an interface for customizing an implementation of a voice-based information retrieval system executed by a virtual assistant. The virtual assistant has been previously trained for natural language understanding (NLU) of speech input indicating selection of some menu items. For other menu items, the customization portal allows the use of context-independent signifiers (e.g., letters or numbers) or custom signifiers (e.g., free-form text) that avoid the need for NLU with respect to selection of those menu items. This approach allows the system to provide a natural-feeling conversation for the user, while also providing the flexibility to present custom menu choices and content to a user without specialized NLU training.

Abstract: A server system, the server system including: a memory processor; and a communication link, where the server system includes a program designed to construct a user interface experience graph from a plurality of prior user experience interfacing with a specific software application, and where the prior user experience interfacing had been received into a memory of the memory processor by the communication link.

Abstract: To propose an information processing apparatus and information processing method and program capable of allowing users to share their viewpoints or lines of sight in a situation where a plurality of users share content for which the users can move their viewpoints or line-of-sight directions. Provided is an information processing apparatus including: an acquisition unit configured to acquire line-of-sight information indicating a first user's line of sight detected in response to presentation of a content; and a management unit configured to associate the acquired line-of-sight information with the content as control information for controlling the presentation of the content to a second user different from the first user.

Abstract: A method and a virtual agent system services a user request from a user. The virtual agent system includes: (a) a conversational user interface receiving the user request and communicating with two or more virtual agents; and (b) a dialog manager including a natural language processing module, that directs operations of the conversational user interface, wherein the dialog manager (i) receives and analyzes the user request from the conversation user interface using the natural language processing module, (ii) causes the conversational user interface to request and to receive a response to the user request from each of the virtual agents, and (iii) integrates the received responses to the user request into an integrated response based on the natural language processing module and causes the conversational user interface to provide the integrated response to the user.

Abstract: A method at a first electronic device with a display and an input device includes: displaying a message input area along with a graphical input stream in a first application, where the graphical input stream includes a source of predefined graphical images and a source for a coded character set. The method includes detecting entry of one or more objects from the graphical input stream into the message input area and receiving a user input to transmit the contents of the message input area. In response to receiving the user input to transmit, and in accordance with a determination that the one or more objects includes a predefined graphical image, the method includes forming a merged message comprising the contents of the message input area, including the predefined graphical image, where a merged message is an image, and transmitting the merged message to a recipient or another application.

Abstract: A computer-implemented method comprising: determining, by a computing device, characteristics of a social media message; selecting, by the computing device, a particular image, of a plurality of images, based on the characteristics of the social media message and characteristics of the particular image; and outputting, by the computing device, information identifying the selected image to incorporate the selected image in a user's social media profile.

Abstract: A user activity pattern may be ascertained using signal data from a set of computing devices. The activity pattern may be used to infer user intent with regards to a user interaction with a computing device or to predict a likely future action by the user. In one implementation, a set of computing devices is monitored to detect user activities using sensors associated with the computing devices. Activity features associated with the detected user activities are determined and used to identify an activity pattern based on a plurality of user activities having similar features. Examples of user activity patterns may include patterns based on time, location, content, or other context. The inferred user intent or predicted future actions may be used to facilitate understanding user speech or determining a semantic understanding of the user.

Abstract: Artificial intelligence (AI) technology can be used in combination with composable communication goal statements and an ontology to facilitate a user's ability to quickly structure story outlines in a manner usable by an NLG narrative generation system without any need for the user to directly author computer code. This AI technology permits NLG systems to determine the appropriate content for inclusion in a narrative story about a data set in a manner that will satisfy a desired communication goal.

Abstract: To automatically select a video of a location matching a hobby or a taste of a passenger, and display the video in a vehicle interior. A display control device includes: an acquisition unit configured to acquire passenger information of a mobile object; a specification unit configured to specify a location suitable for a hobby or a taste of a passenger on the basis of the passenger information; and a control unit configured to control a video displayed in the mobile object on the basis of the specified location. For example, the acquisition unit acquires at least one of an image accumulated in the information terminal or history information of processing executed by the information terminal, as the passenger information, and the specification unit specifies the location on the basis of an analysis result of the image or the history information.