Abstract: A system for monitoring and improving social agent interaction quality includes a computing platform having processing hardware and a system memory storing a software code. The processing hardware is configured to execute the software code to receive, from a social agent, interaction data describing an interaction of the social agent with a user, and to perform an assessment of the interaction, using the interaction data, as one of successful or including a flaw. When the assessment indicates that the interaction includes the flaw, the processing hardware is further configured to execute the software code to identify an interaction strategy for correcting the flaw, and to deliver, to the social agent, one or both of the assessment and the interaction strategy to correct the flaw in the interaction.

Abstract: An interactive autonomous robot is configured for deployment within a social environment. The disclosed robot includes a show subsystem configured to select between different in-character behaviors depending on robot status, thereby allowing the robot to appear in-character despite technical failures. The disclosed robot further includes a safety subsystem configured to intervene with in-character behavior when necessary to enforce safety protocols. The disclosed robot is also configured with a social subsystem that interprets social behaviors of humans and then initiates specific behavior sequences in response.

Abstract: Systems and methods are presented for immersive and simultaneous animation in a mixed reality environment. Techniques disclosed represent a physical object, present at a scene, in a 3D space of a virtual environment associated with the scene. A virtual element is posed relative to the representation of the physical object in the virtual environment. The virtual element is displayed to users from a perspective of each user in the virtual environment. Responsive to an interaction of one user with the virtual element, an edit command is generated and the pose of the virtual element is adjusted in the virtual environment according to the edit command. The display of the virtual element to the users is then updated according to the adjusted pose. When simultaneous and conflicting edit commands are generated by collaborating users, policies to reconcile the conflicting edit commands are disclosed.

Abstract: A system for monitoring and improving social agent interaction quality includes a computing platform having processing hardware and a system memory storing a software code. The processing hardware is configured to execute the software code to receive, from a social agent, interaction data describing an interaction of the social agent with a user, and to perform an assessment of the interaction, using the interaction data, as one of successful or including a flaw. When the assessment indicates that the interaction includes the flaw, the processing hardware is further configured to execute the software code to identify an interaction strategy for correcting the flaw, and to deliver, to the social agent, one or both of the assessment and the interaction strategy to correct the flaw in the interaction.

Abstract: Embodiments provide interactive artificial intelligence. Input to an artificial intelligence (AI) system is received, where the AI system comprises a plurality of machine learning (ML) models. A context of the input is determined, where the context indicates a role-playing scenario. A first ML model of the plurality of ML models is then selected based on the determined context, where the first ML model was trained based at least in part on the role-playing scenario. Output is generated by processing the input using the first ML model. The output is then returned.

Abstract: A system for mediating interactions among system agents and system clients includes a computing platform having a hardware processor and a system memory storing an interaction cueing software code including decision trees corresponding to storylines. The hardware processor executes the interaction cueing software code to receive interaction data corresponding to an interaction of a system client with a first system agent, identify a storyline for use in guiding subsequent interactions with the system client based on the interaction data, and store the interaction data and data identifying the storyline in a client profile assigned to the system client. The interaction cueing software code further determines an interaction cue or cues for coaching the same or another system agent in a second interaction with the system client based on the interaction data and a decision tree corresponding to the storyline, and transmits the interaction cue(s) to the system agent.

Abstract: An interactive autonomous robot is configured for deployment within a social environment. The disclosed robot includes a show subsystem configured to select between different in-character behaviors depending on robot status, thereby allowing the robot to appear in-character despite technical failures. The disclosed robot further includes a safety subsystem configured to intervene with in-character behavior when necessary to enforce safety protocols. The disclosed robot is also configured with a social subsystem that interprets social behaviors of humans and then initiates specific behavior sequences in response.

Abstract: A system for mediating interactions among system agents and system clients includes a computing platform having a hardware processor and a system memory storing an interaction cueing software code including decision trees corresponding to storylines. The hardware processor executes the interaction cueing software code to receive interaction data corresponding to an interaction of a system client with a first system agent, identify a storyline for use in guiding subsequent interactions with the system client based on the interaction data, and store the interaction data and data identifying the storyline in a client profile assigned to the system client. The interaction cueing software code further determines an interaction cue or cues for coaching the same or another system agent in a second interaction with the system client based on the interaction data and a decision tree corresponding to the storyline, and transmits the interaction cue(s) to the system agent.

Abstract: A system for mediating interactions among system agents and system clients includes a computing platform having a hardware processor and a system memory storing an interaction cueing software code including decision trees corresponding to storylines. The hardware processor executes the interaction cueing software code to receive interaction data corresponding to an interaction of a system client with a first system agent, identify a storyline for use in guiding subsequent interactions with the system client based on the interaction data, and store the interaction data and data identifying the storyline in a client profile assigned to the system client. The interaction cueing software code further determines an interaction cue or cues for coaching the same or another system agent in a second interaction with the system client based on the interaction data and a decision tree corresponding to the storyline, and transmits the interaction cue(s) to the system agent.

Abstract: A method for facilitating and enhancing computer-based authoring of gesture definitions that are useful in controlling a walk-around character and other systems using gesture controls. The method includes, during performance of a gesture by a performer, collecting sets of raw sensor data each corresponding to differing parameters of the performance of the gesture. The method includes displaying a graphical user interface with a graphical plot of each of the sets of raw sensor data. The method includes receiving user input identifying which of the parameters to include in a gesture definition. The method includes, for the graphical plots associated with the chosen parameters receiving user input defining a starting position, an ending position, a maximum value, and a minimum value. The gesture may involve movement of a performer's arms, legs, hands, head, eyes, and so on in a particular manner.

Abstract: A system for mediating interactions among system agents and system clients includes a computing platform having a hardware processor and a system memory storing an interaction cueing software code including decision trees corresponding to storylines. The hardware processor executes the interaction cueing software code to receive interaction data corresponding to an interaction of a system client with a first system agent, identify a storyline for use in guiding subsequent interactions with the system client based on the interaction data, and store the interaction data and data identifying the storyline in a client profile assigned to the system client. The interaction cueing software code further determines an interaction cue or cues for coaching the same or another system agent in a second interaction with the system client based on the interaction data and a decision tree corresponding to the storyline, and transmits the interaction cue(s) to the system agent.

Abstract: A method for facilitating and enhancing computer-based authoring of gesture definitions that are useful in controlling a walk-around character and other systems using gesture controls. The method includes, during performance of a gesture by a performer, collecting sets of raw sensor data each corresponding to differing parameters of the performance of the gesture. The method includes displaying a graphical user interface with a graphical plot of each of the sets of raw sensor data. The method includes receiving user input identifying which of the parameters to include in a gesture definition. The method includes, for the graphical plots associated with the chosen parameters receiving user input defining a starting position, an ending position, a maximum value, and a minimum value. The gesture may involve movement of a performer's arms, legs, hands, head, eyes, and so on in a particular manner.

Abstract: A control system for selectively operating a sound system provided in a walk-around character costume. e.g., to play audio files in an order defined by a dialog tree that can be navigated by a performer wearing the costume. The control system includes a trigger mechanism provided in the costume operable by a performer wearing the costume to generate and transmit at least one trigger signal to navigate through a dialog tree. A controller receives the trigger signal and transmits a control signal causing the sound system to playback pre-recorded dialog. The system includes a trigger processing module run by the controller for processing the trigger signal and, in response to such processing, for navigating pre-recorded audio for a show to select the set of pre-recorded dialog. The trigger mechanism includes a first and a second pressure sensor in a thumb and index finger of a glove of the costume.

Abstract: A control system for selectively operating a sound system provided in a walk-around character costume. e.g., to play audio files in an order defined by a dialog tree that can be navigated by a performer wearing the costume. The control system includes a trigger mechanism provided in the costume operable by a performer wearing the costume to generate and transmit at least one trigger signal to navigate through a dialog tree. A controller receives the trigger signal and transmits a control signal causing the sound system to playback pre-recorded dialog. The system includes a trigger processing module run by the controller for processing the trigger signal and, in response to such processing, for navigating pre-recorded audio for a show to select the set of pre-recorded dialog. The trigger mechanism includes a first and a second pressure sensor in a thumb and index finger of a glove of the costume.

Abstract: A method is provided for a simulated conversation by a pre-recorded audio navigator, with particular application to informational and entertainment settings. A monitor may utilize a navigation interface to select pre-recorded responses in the voice of a character represented by a performer. The pre-recorded responses may then be queued and sent to a speaker proximate to the performer. By careful organization of an audio database including audio buckets and script-based navigation with shifts for tailoring to specific guest user profiles and environmental contexts, a convincing and dynamic simulated conversation may be carried out while providing the monitor with a user-friendly navigation interface. Thus, highly specialized training is not necessary and flexible scaling to large-scale deployments is readily supported.

Abstract: A method is provided for a simulated conversation by a pre-recorded audio navigator, with particular application to informational and entertainment settings. A monitor may utilize a navigation interface to select pre-recorded responses in the voice of a character represented by a performer. The pre-recorded responses may then be queued and sent to a speaker proximate to the performer. By careful organization of an audio database including audio buckets and script-based navigation with shifts for tailoring to specific guest user profiles and environmental contexts, a convincing and dynamic simulated conversation may be carried out while providing the monitor with a user-friendly navigation interface. Thus, highly specialized training is not necessary and flexible scaling to large-scale deployments is readily supported.