Abstract: In some implementations, a system may obtain a transcript that includes interactions between a user and an entity. The system may extract a first quantity of key phrases from a first portion of the transcript that corresponds to an entirety of the transcript and may extract a second quantity of key phrases from a second portion of the transcript that corresponds to a subset of the entirety of the transcript. The system may assign one or more key phrases to one or more topics, and may calculate a topic frequency that indicates a total quantity of key phrases associated with the topic. The system may generate a third set of topics that includes one or more topics having a topic frequency that satisfies a topic frequency threshold.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for controlling an agent interacting with an environment. In one aspect, a method comprises: receiving an observation that characterizes the environment; receiving a conditioning input that characterizes a task to be performed by the agent in the environment; for each of a plurality of sub-regions of the observation, generating an observation patch embedding of the sub-region; generating a conditioning input embedding of the conditioning input; processing the observation patch embeddings and the conditioning input embedding to generate a policy output that defines an action to be performed by the agent in response to the observation, wherein the processing comprises applying a linear attention mechanism over the observation patch embeddings and the conditioning input embedding; selecting an action to be performed by the agent using the policy output; and causing the agent to perform the selected action.

Abstract: In some implementations, a system may obtain a transcript that includes interactions between a user and an entity. The system may extract a first quantity of key phrases from a first portion of the transcript that corresponds to an entirety of the transcript and may extract a second quantity of key phrases from a second portion of the transcript that corresponds to a subset of the entirety of the transcript. The system may assign one or more key phrases to one or more topics, and may calculate a topic frequency that indicates a total quantity of key phrases associated with the topic. The system may generate a third set of topics that includes one or more topics having a topic frequency that satisfies a topic frequency threshold.

Abstract: In some embodiments, a computing system computes, with a state prediction model, probabilities of transitioning from a click state represented by interaction data to various predicted next states. The computing system computes an interface experience metric for the click with an experience valuation model. To do so, the computing system identifies base values for the click state and the predicted next states. The computing system computes value differentials for between the click state's base value and each predicted next state's base value. Value differentials indicate qualities of interface experience. The computing system determines the interface experience metric from a summation that includes the current click state's base value and the value differentials weighted with the predicted next states' probabilities.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training neural networks. One of the methods for training a neural network configured to perform a machine learning task includes performing, at each of a plurality of iterations: performing a training step to obtain respective new gradients of a loss function; for each network parameter: generating an optimizer network input; processing the optimizer network input using an optimizer neural network, wherein the processing comprises, for each cell: generating a cell input for the cell; and processing the cell input for the cell to generate a cell output, wherein the processing comprises: obtaining latent embeddings from the cell input; generating the cell output from the hidden state; and determining an update to the hidden state; and generating an optimizer network output defining an update for the network parameter; and applying the update to the network parameter.

Abstract: A method includes identifying interaction data associated with user interactions with a user interface of an interactive computing environment. The method also includes computing goal clusters of the interaction data based on sequences of the user interactions and performing inverse reinforcement learning on the goal clusters to return rewards and policies. Further, the method includes computing likelihood values of additional sequences of user interactions falling within the goal clusters based on the policies corresponding to each of the goal clusters and assigning the additional sequences to the goal clusters with greatest likelihood values. Furthermore, the method includes computing interface experience metrics of the additional sequences using the rewards and the policies corresponding to the goal clusters of the additional sequences and transmitting the interface experience metrics to the online platform.

Abstract: A method includes accessing a subject entity and a subject relation of a focal platform and accessing a knowledge graph representative of control performance data. Further, the method includes computing a set of ranked target entities that cause the subject entity based on the subject relation or are an effect of the subject entity based on the subject relation. Computing the set of ranked target entities is performed using relational hops from the subject entity within the knowledge graph performed using the subject relation and reward functions. The method also includes transmitting the set of ranked target entities to the focal platform. The set of ranked target entities is usable for modifying a user interface of an interactive computing environment provided by the focal platform.

Abstract: There is described a method and system in an interactive computing environment modified with user experience values based on behavior logs. An experience valuation system determines an experience value and an estimated experience value. The experience value is based on a current state of interaction data from a user session, based on a history of past events, and an estimation function defined by parameters to model the user experience values. The estimated experience value is determined based on, in addition to the current state and the estimation function, next states associated with the current state, and a reward function. The parameters of the estimation function are updated based on a comparison of the expected experience value and the estimated experience value. For another aspect, the method and system may further include a state prediction system to determine probabilities of transitioning that may be applied to determine the estimated experience value.

Abstract: A method includes identifying interaction data associated with user interactions with a user interface of an interactive computing environment. The method also includes computing goal clusters of the interaction data based on sequences of the user interactions and performing inverse reinforcement learning on the goal clusters to return rewards and policies. Further, the method includes computing likelihood values of additional sequences of user interactions falling within the goal clusters based on the policies corresponding to each of the goal clusters and assigning the additional sequences to the goal clusters with greatest likelihood values. Furthermore, the method includes computing interface experience metrics of the additional sequences using the rewards and the policies corresponding to the goal clusters of the additional sequences and transmitting the interface experience metrics to the online platform.

Abstract: An example chatbot generation platform may receive a request to generate a chatbot; determine a chatbot template for the chatbot based on the request; obtain custom chatbot information according to the chatbot template; generate a chatbot corpus for the chatbot using the custom chatbot information and the chatbot template; generate a set of question and answer (QnA) pairs based on the chatbot corpus; configure a language analysis model for the chatbot; build the chatbot according to the set of QnA pairs and the language analysis model; and deploy the chatbot to a chatbot host platform for operation. The chatbot may be built to engage in an interaction with a user via the chatbot host platform, use the language analysis model to select one or more QnA pairs from the set of QnA pairs during the interaction, and train the language analysis model based on the interaction.

Abstract: In some embodiments, a computing system computes, with a state prediction model, probabilities of transitioning from a click state represented by interaction data to various predicted next states. The computing system computes an interface experience metric for the click with an experience valuation model. To do so, the computing system identifies base values for the click state and the predicted next states. The computing system computes value differentials for between the click state's base value and each predicted next state's base value. Value differentials indicate qualities of interface experience. The computing system determines the interface experience metric from a summation that includes the current click state's base value and the value differentials weighted with the predicted next states' probabilities.

Abstract: In some embodiments, interaction data associated with user interactions with a user interface of an interactive computing environment is identified, and goal clusters of the interaction data are computed based on sequences of the user interactions and performing inverse reinforcement learning on the goal clusters to return rewards and policies. Further, likelihood values of additional sequences of user interactions falling within the goal clusters are computed based on the policies corresponding to each of the goal clusters and assigning the additional sequences to the goal clusters with greatest likelihood values. Computing interface experience metrics of the additional sequences are computed using the rewards and the policies corresponding to the goal clusters of the additional sequences and transmitting the interface experience metrics to the online platform. The interface experience metrics are usable for changing arrangements of interface elements to improve the interface experience metrics.

Abstract: In some embodiments, a computing system computes, with a state prediction model, probabilities of transitioning from a click state represented by interaction data to various predicted next states. The computing system computes an interface experience metric for the click with an experience valuation model. To do so, the computing system identifies base values for the click state and the predicted next states. The computing system computes value differentials for between the click state's base value and each predicted next state's base value. Value differentials indicate qualities of interface experience. The computing system determines the interface experience metric from a summation that includes the current click state's base value and the value differentials weighted with the predicted next states' probabilities.

Abstract: In some embodiments, interaction data associated with user interactions with a user interface of an interactive computing environment is identified, and goal clusters of the interaction data are computed based on sequences of the user interactions and performing inverse reinforcement learning on the goal clusters to return rewards and policies. Further, likelihood values of additional sequences of user interactions falling within the goal clusters are computed based on the policies corresponding to each of the goal clusters and assigning the additional sequences to the goal clusters with greatest likelihood values. Computing interface experience metrics of the additional sequences are computed using the rewards and the policies corresponding to the goal clusters of the additional sequences and transmitting the interface experience metrics to the online platform. The interface experience metrics are usable for changing arrangements of interface elements to improve the interface experience metrics.

Abstract: A method includes accessing a subject entity and a subject relation of a focal platform and accessing a knowledge graph representative of control performance data. Further, the method includes computing a set of ranked target entities that cause the subject entity based on the subject relation or are an effect of the subject entity based on the subject relation. Computing the set of ranked target entities is performed using relational hops from the subject entity within the knowledge graph performed using the subject relation and reward functions. The method also includes transmitting the set of ranked target entities to the focal platform. The set of ranked target entities is usable for modifying a user interface of an interactive computing environment provided by the focal platform.

Abstract: An example chatbot generation platform may receive a request to generate a chatbot; determine a chatbot template for the chatbot based on the request; obtain custom chatbot information according to the chatbot template; generate a chatbot corpus for the chatbot using the custom chatbot information and the chatbot template; generate a set of question and answer (QnA) pairs based on the chatbot corpus; configure a language analysis model for the chatbot; build the chatbot according to the set of QnA pairs and the language analysis model; and deploy the chatbot to a chatbot host platform for operation. The chatbot may be built to engage in an interaction with a user via the chatbot host platform, use the language analysis model to select one or more QnA pairs from the set of QnA pairs during the interaction, and train the language analysis model based on the interaction.

Abstract: Systems and methods provide for generating predictive models that are useful in predicting next-user-actions. User-specific navigation sequences are obtained, the navigation sequences representing temporally-related series of actions performed by users during navigation sessions. To each navigation sequence, a Recurrent Neural Network (RNN) is applied to encode the navigation sequences into user embeddings that reflect time-based, sequential navigation patterns for the user. Once a set of navigation sequences is encoded to a set of user embeddings, a variety of classifiers (prediction models) may be applied to the user embeddings to predict what a probable next-user-action may be and/or the likelihood that the next-user-action will be a desired target action.

Abstract: Systems and methods provide for generating predictive models that are useful in predicting next-user-actions. User-specific navigation sequences are obtained, the navigation sequences representing temporally-related series of actions performed by users during navigation sessions. To each navigation sequence, a Recurrent Neural Network (RNN) is applied to encode the navigation sequences into user embeddings that reflect time-based, sequential navigation patterns for the user. Once a set of navigation sequences is encoded to a set of user embeddings, a variety of classifiers (prediction models) may be applied to the user embeddings to predict what a probable next-user-action may be and/or the likelihood that the next-user-action will be a desired target action.

Abstract: There is described a method and system in an interactive computing environment modified with user experience values based on behavior logs. An experience valuation system determines an experience value and an estimated experience value. The experience value is based on a current state of interaction data from a user session, based on a history of past events, and an estimation function defined by parameters to model the user experience values. The estimated experience value is determined based on, in addition to the current state and the estimation function, next states associated with the current state, and a reward function. The parameters of the estimation function are updated based on a comparison of the expected experience value and the estimated experience value. For another aspect, the method and system may further include a state prediction system to determine probabilities of transitioning that may be applied to determine the estimated experience value.

Abstract: Systems and methods provide for generating predictive models that are useful in predicting next-user-actions. User-specific navigation sequences are obtained, the navigation sequences representing temporally-related series of actions performed by users during navigation sessions. To each navigation sequence, a Recurrent Neural Network (RNN) is applied to encode the navigation sequences into user embeddings that reflect time-based, sequential navigation patterns for the user. Once a set of navigation sequences is encoded to a set of user embeddings, a variety of classifiers (prediction models) may be applied to the user embeddings to predict what a probable next-user-action may be and/or the likelihood that the next-user-action will be a desired target action.