Abstract: A system, method, and computer-readable medium for modeling and diagnosing a system. System identification information captured by an AR system is used to identify the system and one or more of a model of the components of the system or an overlay of the system is retrieved from a repository or generated based on component identification information or component performance data and sent to the AR system. A composite view of the model or overlay relative to a dynamic image or model of the system allows a technician to visualize the system and components and diagnose the operation of the system without opening the system.

Abstract: A wearable system can comprise a display system configured to present virtual content in a three-dimensional space, a user input device configured to receive a user input, and one or more sensors configured to detect a user's pose. The wearable system can support various user interactions with objects in the user's environment based on contextual information. As an example, the wearable system can adjust the size of an aperture of a virtual cone during a cone cast (e.g., with the user's poses) based on the contextual information. As another example, the wearable system can adjust the amount of movement of virtual objects associated with an actuation of the user input device based on the contextual information.

Abstract: The present invention is an action agent architecture in a scalable multi-service virtual assistant platform that can construct a fluid and dynamic dialogue by assembling responses to end user utterances from two kinds of agents, information agents and action agents. A plurality of information agents obtain at least one information value from a parsed user input and/or contextual data. A plurality of action agents perform one or more actions in response to the parsed user input, the contextual data, and/or an information value obtained from at least one of the information agents. The plurality of action agents are created through a declarative language by specifying one or more triggering conditions, one or more action invocation parameters, one or more information agents as pre-requisites, and one or more responses. A natural language generation (NLG) module renders a response back to the user after the one or more actions are performed.

Abstract: Embodiments describe an approach for generating a sign language translation of an audio portion of a video. Embodiments receive a request for a sign language translation for a selected video and extract audio from the selected video. Additionally, embodiments, convert the extracted audio into text, identify contextual sounds in the audio, and convert the text and the contextual sounds into sign language content. Furthermore, embodiments, generate a sign language video based on the sign language content, and display the sign language video in a separate display window on the selected video.

Abstract: A system for providing a virtual reality system is disclosed. In particular, the system provides a game-simulation hybrid that provides a massive online virtual world and accompanying network based around user profiles, events, activities, challenges, virtual lifestyle, and advertising. The system enables users to actively participate in live events or activities occurring in locations remote from the users by rendering digital versions of the live events or activities via applications executing on the computing devices of the users. The digital versions of the live events may be rendered within the virtual world and the system may enable users to interact in the virtual world in meaningful ways. For example, the system may enable users to communicate with other users during the rendering of the live events or activities, participate in the rendered live events with other users, interact with and purchase various rendered goods and services, among other functionality.

Abstract: An information management method collects log information of one or more home electrical apparatuses corresponding to service providers. Display screen data is generated which indicates a status of the log information. The display screen data includes groups of information which each contain information on an apparatus, a service provider corresponding to the apparatus, and log information output from the apparatus. Provision of the log information of each group is individually selectable. The display screen data is provided via a network to a display terminal that performs access to a server device. Information is received from the display terminal, which indicates that selection on whether or not provision of the log information is performed. Provision of the log information is not performed on the selected group when a determination is made that refusal of provision of the log information on the selected group is performed.

Abstract: An electronic system for a vehicle includes a memory and a control circuitry. The memory stores a three-dimensional (3D) model associated with the vehicle. The 3D model is a trained machine learning (ML) model that is trained using a first set of two-dimensional (2D) images as training data associated with the vehicle. The control circuitry receives a user input to display user-assistive information associated with the vehicle. The control circuitry generates a visual representation that corresponds to at least one of a first view of the vehicle or a second view of a component of the vehicle, based on the stored 3D model. The generated visual representation is different from the first set of 2D images. The control circuitry controls display of the user-assistive information that includes the generated visual representation on a display screen of the vehicle.

Abstract: Disclosed herein is a system for facilitating the generation of a customized response based on a context, in accordance with some embodiments. Accordingly, the system may include a communication device configured for receiving at least one sensor data from at least one sensor associated with at least one user. Further, the system may include a processing device configured for analyzing the at least one sensor data and determining a context based on analyzing. Further, the processing device may be configured for identifying a customized profile associated with the context. Further, the system may include a storage device configured for retrieving the customized profile. Further, the processing device may be configured for generating a customized response based on the at least one sensor data and the customized profile. Further, the system may include a presentation device. Further, the presentation device may be configured to present the customized response.

Abstract: A method comprises a computer-implemented contextual virtual assistant (CVA) analyzing one or of a user corpus and input user information to determine to communicate user information to a primary recipient. In the method, the CVA receives information associated with a recipient context that includes the primary recipient, and can determine from the context information that an ancillary recipient is privy, in the recipient context, to information output by the system. The CVA further determines, in the method, output information, based on the user information, and a recipient context to communicate to the primary recipient. The recipient context, comprises a preferred location of the primary recipient, and preferred time, to communicate the output information. A CVA system includes a user corpus, CVA input and output devices, and processors. The processors can perform the method. A computer program product can include instructions to cause one or more processors to perform the method.

Abstract: Embodiments described herein reduce the probability that a user of a VR environment can nefariously rig a system to positively and/or negatively influence another user's reputation score. Information indicative of a positive or negative interaction between an avatar of a first user and an avatar of a second user is received from a client computing device used by the first user. Further information is received from a client computing device used by a third user of the VR environment, and based thereon, there is a determination whether the positive or negative interaction is corroborated or contradicted. If corroborated, a reputation score associated with the second user is increased or decreased. If contradicted, the reputation score associated with the second user is not adjusted, and the reputation score of the first user may be decreased. Such reputation scores can be accessed and used by a user using a client computing device.

Abstract: An example augmented reality system includes: obtaining information about an instance of a device; recognizing the instance of the device based on the information; selecting a digital twin for the instance of the device, with the digital twin being unique to the instance of the device; and generating augmented reality content based on the digital twin and an actual graphic of the instance of the device.

Abstract: A system provides, based at least in part on predetermined parameters, configuration information, and a group of behavioral agents, a dynamic virtual representation that includes a multi-dimensional puppet having one or more attributes of an individual, where the dynamic virtual representation automatically mimics one or more attributes of the individual in a context, the providing of the dynamic virtual representation that includes the multi-dimensional puppet involves rendering of the multi-dimensional puppet, and the multi-dimensional puppet includes stereopsis information, and has photorealistic movement corresponding to movement behaviors of the individual. Then, the system receives an input corresponding to user spatial manipulation of or interaction with the multi-dimensional puppet.

Abstract: A message reminder system, to perform operations that include: causing display of a presentation of a message addressed to a user, at a first position among a message feed of the user at a client device; receiving a request to open the message from the user of the client device, the request including a timestamp; detecting a trigger event based on at least the timestamp of the request to open the message, the trigger event comprising event attributes; generating a notification to be applied to the presentation of the message, the notification based on at least the event attributes of the trigger event; moving the presentation of the message from the first position among the message feed to a second position among the message feed; and applying the notification to the presentation of the message.

Abstract: A cognitive agent system provides a centralized capability for users to configure and deploy cognitive agents across multiple heterogeneous vendor platforms. The cognitive agent system provides a design environment that allows users to define skills, as well as a new conversation construct that supports more complex interactions with users. The cognitive agent system also includes a deployment environment that allows users to register users and cognitive agents, deploy skills and conversations, and monitor the activity of cognitive agents across multiple vendor platforms. These users may use the cognitive agent system to define skills and conversations once and then deploy the skills and conversations to multiple service endpoints across different vendor platforms. In addition, the cognitive agent system allows user to directly manage cognitive agents that are not specific to any particular vendor.

Abstract: A system and method for providing virtual interpersonal communication that include receiving data associated with one-to-one interpersonal communication between a user and a target individual. The system and method also include determining at least one contextual data point and at least one associated behavioral attribute of the user and the target individual during the one-to-one interpersonal communication. The system and method additionally include analyzing at least one statement spoken by the user to a virtual representation of the target individual and presenting a virtual avatar of the target individual in a manner that replicates the personality of the target individual and communicates with the user based on the at least one contextual data point and the at least one associated behavioral attribute.

Abstract: Systems and techniques for the collection and display of athletic information. Athletic data relating to a single person or group of people is collected at a central location, and subsequently displayed at a desired remote location so that the person or people can review and critique their performance. In addition, athletic data for multiple persons can be collected at a central location, and subsequently displayed to a user at a desired remote location, so that the user can compare his or her athletic activities to others.

Abstract: A customization portal provides an interface for customizing an implementation of a voice-based information retrieval system executed by a virtual assistant. The virtual assistant has been previously trained for natural language understanding (NLU) of speech input indicating selection of some menu items. For other menu items, the customization portal allows the use of context-independent signifiers (e.g., letters or numbers) or custom signifiers (e.g., free-form text) that avoid the need for NLU with respect to selection of those menu items. This approach allows the system to provide a natural-feeling conversation for the user, while also providing the flexibility to present custom menu choices and content to a user without specialized NLU training.

Abstract: A server system, the server system including: a memory processor; and a communication link, where the server system includes a program designed to construct a user interface experience graph from a plurality of prior user experience interfacing with a specific software application, and where the prior user experience interfacing had been received into a memory of the memory processor by the communication link.

Abstract: To propose an information processing apparatus and information processing method and program capable of allowing users to share their viewpoints or lines of sight in a situation where a plurality of users share content for which the users can move their viewpoints or line-of-sight directions. Provided is an information processing apparatus including: an acquisition unit configured to acquire line-of-sight information indicating a first user's line of sight detected in response to presentation of a content; and a management unit configured to associate the acquired line-of-sight information with the content as control information for controlling the presentation of the content to a second user different from the first user.

Abstract: A method and a virtual agent system services a user request from a user. The virtual agent system includes: (a) a conversational user interface receiving the user request and communicating with two or more virtual agents; and (b) a dialog manager including a natural language processing module, that directs operations of the conversational user interface, wherein the dialog manager (i) receives and analyzes the user request from the conversation user interface using the natural language processing module, (ii) causes the conversational user interface to request and to receive a response to the user request from each of the virtual agents, and (iii) integrates the received responses to the user request into an integrated response based on the natural language processing module and causes the conversational user interface to provide the integrated response to the user.

Abstract: A method at a first electronic device with a display and an input device includes: displaying a message input area along with a graphical input stream in a first application, where the graphical input stream includes a source of predefined graphical images and a source for a coded character set. The method includes detecting entry of one or more objects from the graphical input stream into the message input area and receiving a user input to transmit the contents of the message input area. In response to receiving the user input to transmit, and in accordance with a determination that the one or more objects includes a predefined graphical image, the method includes forming a merged message comprising the contents of the message input area, including the predefined graphical image, where a merged message is an image, and transmitting the merged message to a recipient or another application.

Abstract: A computer-implemented method comprising: determining, by a computing device, characteristics of a social media message; selecting, by the computing device, a particular image, of a plurality of images, based on the characteristics of the social media message and characteristics of the particular image; and outputting, by the computing device, information identifying the selected image to incorporate the selected image in a user's social media profile.

Abstract: A user activity pattern may be ascertained using signal data from a set of computing devices. The activity pattern may be used to infer user intent with regards to a user interaction with a computing device or to predict a likely future action by the user. In one implementation, a set of computing devices is monitored to detect user activities using sensors associated with the computing devices. Activity features associated with the detected user activities are determined and used to identify an activity pattern based on a plurality of user activities having similar features. Examples of user activity patterns may include patterns based on time, location, content, or other context. The inferred user intent or predicted future actions may be used to facilitate understanding user speech or determining a semantic understanding of the user.

Abstract: Artificial intelligence (AI) technology can be used in combination with composable communication goal statements and an ontology to facilitate a user's ability to quickly structure story outlines in a manner usable by an NLG narrative generation system without any need for the user to directly author computer code. This AI technology permits NLG systems to determine the appropriate content for inclusion in a narrative story about a data set in a manner that will satisfy a desired communication goal.

Abstract: To automatically select a video of a location matching a hobby or a taste of a passenger, and display the video in a vehicle interior. A display control device includes: an acquisition unit configured to acquire passenger information of a mobile object; a specification unit configured to specify a location suitable for a hobby or a taste of a passenger on the basis of the passenger information; and a control unit configured to control a video displayed in the mobile object on the basis of the specified location. For example, the acquisition unit acquires at least one of an image accumulated in the information terminal or history information of processing executed by the information terminal, as the passenger information, and the specification unit specifies the location on the basis of an analysis result of the image or the history information.

Abstract: Systems and methods for designing and customizing tangible products are disclosed. Examples may include apparel, such as footwear, shirts, or sporting goods, athletic equipment and/or electronic devices, including but not limited to activity monitoring devices or media devices. Aspects relate to customizing products based on visual and tactile properties of the materials to be utilized in the design and construction of the product. Both the visual and tactile property selections may be displayed to the consumer to on an exemplary graphical representation of the product. Embodiments allow a user to select and review both visual and tactile properties of the product, thus the consumer is able to visualize and touch the materials of a customized product.

Abstract: A wearable system can comprise a display system configured to present virtual content in a three-dimensional space, a user input device configured to receive a user input, and one or more sensors configured to detect a user's pose. The wearable system can support various user interactions with objects in the user's environment based on contextual information. As an example, the wearable system can adjust the size of an aperture of a virtual cone during a cone cast (e.g., with the user's poses) based on the contextual information. As another example, the wearable system can adjust the amount of movement of virtual objects associated with an actuation of the user input device based on the contextual information.

Abstract: The present disclosure provides computer systems, apparatuses, computer-executable methods and one or more non-transitory computer-readable media for implementing a virtual representation of a physical environment using a virtual reality environment. An example method includes receiving a first set of sensor data from a sensor, identifying at least one physical object within a field of view of the sensor from the first set of sensor data, generating a virtual representation of the at least one physical object based at least in part on the first set of sensor data, generating a virtual environment comprising the virtual representation of the at least one physical object and a virtual representation of at least one virtual object, and displaying the virtual environment via a display device.

Abstract: A method of providing private information from an electronic device, includes identifying private information for display on the display of the electronic device, determining if a private output connection is established, and, in response to determining that the private output connection is established, providing the private information via the private output connection.

Abstract: The disclosure includes a method of facilitating storytelling using visual media. In some embodiments, the method includes receiving, via a storyteller device associated with a storyteller, an input. The method may also include identifying, via a processing device communicatively coupled to the storyteller device, visual media based on the input. As well, some embodiments include the step of presenting, via at least one of the storyteller device and a listener device communicatively coupled to the processing device, the visual media. The listener device may be associated with a listener.

Abstract: An approach is provided that identifies a current mood state of a requestor from whom a question has been submitted to a question answering (QA) system. The approach determines, based on the identified mood state, an urgency associated with the requestor. Data pertaining to a number of candidate answers is analyzed with the candidate answers being generated by the QA system. The analysis results in an urgency characteristic that pertains to each of the candidate answers. Scoring of the candidate answers is adjusted based on a comparison of the requestor's urgency and the urgency characteristic associated with the candidate answers. Answers are selected from the candidate answers and returned to the requestor with the selected answers based on the adjusted scoring.

Abstract: Techniques are provided for wake-on-voice (WOV) key-phrase enrollment. A methodology implementing the techniques according to an embodiment includes generating a WOV key-phrase model based on identification of the sequence of sub-phonetic units of a user-provided key-phrase. The WOV key-phrase model is employed by a WOV processor for detection of the user spoken key-phrase and triggering operation of an automatic speech recognition (ASR) processor in response to the detection. The method further includes updating an ASR language model based on the user-provided key-phrase. The update includes one of embedding the WOV key-phrase model into the ASR language model, converting sub-phonetic units of the WOV key-phrase model and embedding the converted WOV key-phrase model into the ASR language model, or generating an ASR key-phrase model by applying a phoneme-syllable based statistical language model to the user-provided key-phrase and embedding the generated ASR key-phrase model into the ASR language model.

Abstract: The subject invention functions to use available data and information to automatically create narrative stories that describes domain events, circumstances and/or entities in a comprehensible and compelling and audience customized, manner. Computer executable instructions provide for generating a narrative story using standard and uniform structures and data for receiving domain related data and a story specification, parsing the story specification to provide constituent components, transforming the constituent components into executable code, instantiating content blocks having at least one feature for the domain according to the story specification and rendering the narrative story using the constituent components specified by the content blocks.

Abstract: Switching real-time data stream connections between network nodes sharing a virtual area is described. In one aspect, the switching involves storing a virtual area specification. The virtual area specification includes a description of one or more switching rules each defining a respective connection between sources of a respective real-time data stream type and sinks of the real-time data stream type in terms of positions in the virtual area. Real-time data stream connections are established between network nodes associated with respective objects each of which is associated with at least one of a source and a sink of one or more of the real-time data stream types. The real-time data stream connections are established based on the one or more switching rules, the respective sources and sinks associated with the objects, and respective positions of the objects in the virtual area.

Abstract: An action control method includes when a first state of a first user in communication with a first machine avatar is detected, specifying a first action of the first machine avatar for changing a state of the first user from the first state to a second state that is more desirable than the first state based on history information indicating changes in states of users in response to actions of machine avatars or different users in communication with the users, and causing the first machine avatar to perform the first action.

Abstract: A system and method for preventing a playback of streaming media content from a streaming media server based on a set of rules governing playback between a group of users includes receiving a selection of a media series available for streaming on a streaming media service to be governed by the set of rules, linking each account to define the group of users, receiving a playback request of the media series from a user of the group of users, determining that the playback request is in violation of the set of rules governing playback of the media series, and denying the playback request from the first user of the group by preventing a transmission of data packets to a computing device associated with the account of the user so that the user is prevented from streaming the media series in accordance with the set of rules.

Abstract: When one node, from nodes included in either a finite state machine including a node to which a state of a character is assigned or a behavior tree including a node to which action content of a character is assigned, is designated in accordance with a user operation, a screen, that is for querying a user as to which of a finite state machine and a behavior tree to assign to the one node, is caused to be displayed on a display screen. One from the finite state machine and the behavior tree that is selected in accordance with a user operation is assigned to the one node.

Abstract: Techniques are described for enabling the selection of wallpaper to modify the mood projected by an avatar. The mood projected by an avatar may be modified, for example, by modifying behaviors and/or appearance of the avatar to characterize a mood to be projected. The mood projected by an avatar also may be modified based on user action, such as user input of a mood to be projected by the avatar.

Abstract: A method of generating an Augmented Reality (AR) display environment includes establishing a data connection at a mobile device to a printer image processing pipeline and generating an augmentation object of a virtual image based on the received printer image. Live video data of the physical environment is received from an imaging sensor on the mobile device, and a local 3D model of the physical environment utilizing the live video data is generated. Device tracking data from the mobile device is used to adapt the local 3D model. The augmentation object is combined with the adapted local 3D model to create an AR display environment, followed by configuring the mobile device to display the AR display environment. A mobile device includes a processor and memory with instructions to configure the device to generate an AR display environment.

Abstract: Artificial intelligence (AI) technology can be used in combination with composable communication goal statements and an ontology to facilitate a user's ability to quickly structure story outlines in a manner usable by an NLG narrative generation system without any need for the user to directly author computer code. This AI technology permits NLG systems to determine the appropriate content for inclusion in a narrative story about a data set in a manner that will satisfy a desired communication goal.

Abstract: The present disclosure generally relates to creating and editing avatars, and navigating avatar selection interfaces. In some examples, an avatar feature user interface includes a plurality of feature options that can be customized to create an avatar. In some examples, different types of avatars can be managed for use in different applications. In some examples, an interface is provided for navigating types of avatars for an application.

Abstract: A garment (e.g., a shirt) for monitoring biometric properties of the wearer of the garment is disclosed. The garment may include sensors for monitoring or assessing biometric properties such as, but not limited to, respiration properties, heart properties, and motion properties. These properties may be assessed together to provide an assessment of vital signs and body position (e.g., three-dimensional body position) of the wearer of the garment.

Abstract: Technologies are described for indicating a geographic origin of a digitally-mediated communication relative to a location of a recipient by presenting the indication in an augmented reality scene. For example, an augmented reality scene can be presented to the recipient. The geographic origin of an incoming digital communication may be determined and a relative location of the origin with respect to the recipient's location may be computed. A format for presenting the relative location may be derived from the digital communication and the geographic origin. The augmented reality scene may be updated with the relative location based on the derived format.

Abstract: A method and system for domain-based rendering of avatars to a user is disclosed. The method includes receiving, by a controller unit of a user device, a user input subsequent to launch of an application in the user device. The method further includes extracting a plurality of keywords and metadata from the user input. The method includes determining an application domain in association with the user input based on the plurality of keywords and the metadata. The method further includes selecting at least one avatar from an avatar database based on the application domain and a plurality of parameters. The method includes rendering the at least one avatar to the user to initiate a conversation.

Abstract: This disclosure relates to systems and methods for gamification of data center transformation. In one embodiment, a processor-implemented method is disclosed, comprising: dynamically generating in real-time, via a hardware processor, a multi-player gaming environment including a plurality of graphical elements; wherein at least one constraint applying to one of the graphical elements reflects a constraint applying to a real-world data center; wherein a configuration of at least one of the graphical elements reflects a configuration parameter of the real-world data center; providing, via the hardware processor, the gaming environment to a plurality of users; modifying, via the hardware processor, the configuration of the at least one of the graphical elements based on game play of the plurality of users; and providing, via the hardware processor, an output indicating a modified configuration of the at least one of the graphical elements for modifying the configuration parameter of the real-world data center.

Abstract: Optimizations are provided for facilitating optimal viewing positions for viewing virtual objects in VR environments. Initially, user selection of a virtual object being rendered in a VR display is detected. Subsequently, an optimal viewing position is dynamically calculated based on one or more characteristic of the virtual object to be viewed. A predetermined triggering event is also detected, and in response to the predetermined triggering event, a scene which is arranged to display the selected virtual object from the optimal viewing position is rendered in the VR display.

Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging software and systems by generating customized images with avatars of different users within electronic messages. For example, users of different mobile computing devices can exchange electronic communications with images generated to include avatars representing themselves as well as their friends, colleagues, and other acquaintances.

Abstract: Systems and methods are described that are configured to obtain tracking data corresponding to a plurality of users accessing a virtual reality environment. The tracking data may include information associated with a plurality of movements performed by a first user in a physical environment. The systems and methods may be configured to modify display data associated with the plurality of movements, in response to determining that the information is private, and provide, in the virtual environment, the modified display data to a second user in the plurality of users, while displaying unmodified display data to the first user.

Abstract: A method for generating a sentiment map user interface is presented. The method may include collecting a plurality of content data, whereby the plurality of content data includes an original message and at least one response. The method may include collecting a plurality content path data. The method may include determining a plurality of user sentiment data based on the collected plurality of content data. The method may include generating the sentiment map user interface based on the determined plurality of user sentiment data and the collected plurality of content path data, whereby the generated sentiment map user interface includes a plurality of user icons indicating a user sentiment, and whereby the plurality of user icons are positioned within the generated sentiment map user interface based on the collected plurality of content path data. The method may include presenting the generated sentiment map user interface to a user.

Abstract: A wearable system can comprise a display system configured to present virtual content in a three-dimensional space, a user input device configured to receive a user input, and one or more sensors configured to detect a user's pose. The wearable system can support various user interactions with objects in the user's environment based on contextual information. As an example, the wearable system can adjust the size of an aperture of a virtual cone during a cone cast (e.g., with the user's poses) based on the contextual information. As another example, the wearable system can adjust the amount of movement of virtual objects associated with an actuation of the user input device based on the contextual information.