Abstract: A system includes a representation generator subsystem configured to execute a user representation model and a task prediction model to generate a user representation for a user. The user representation model receives user event sequence data comprises a sequence of user interactions with the system. The task prediction model is configured to train the user representation model. The user representation includes a vector of a predetermined size that represents the user event sequence data and is generated by applying the trained user representation model to the user event sequence data. A storage requirement of the user representation is less than a storage space requirement of the user event sequence data. The system includes a data store configured for storing the user representation in a user profile associated with the user.

Abstract: A text summarization system auto-generates text summarization models using a combination of neural architecture search and knowledge distillation. Given an input dataset for generating/training a text summarization model, neural architecture search is used to sample a search space to select a network architecture for the text summarization model. Knowledge distillation includes fine-tuning a language model for a given text summarization task using the input dataset, and using the fine-tuned language model as a teacher model to inform the selection of the network architecture and the training of the text summarization model. Once a text summarization model has been generated, the text summarization model can be used to generate summaries for given text.