Abstract: Methods and systems providing examples to a large language model (LLM) are described. A conversation history is maintained for an ongoing conversation between a client and the LLM. A current client message is received from the client. An input is provided to the LLM to instruct the LLM to generate an output in response to the current client message, the input to the LLM including at least a portion of the conversation history and including one or more example message pairs inserted into the portion of the conversation history in proximity to the current client message, wherein each example message pair includes a respective example client message and a respective example LLM message. An LLM message is outputted to the client based on the output generated by the LLM in response to the input. The one or more example message pairs are omitted from the maintained conversation history.

Abstract: Methods and systems for managing functions calls by a large language model are described. A generated message is received from a generative language model, based on an input message in an ongoing conversation, the generated message indicating a function call related to the input message. The function is executed using the function call. A function response is received from the executed function. An output message is provided to the ongoing conversation based on the function response, wherein the providing of the output message bypasses the generative language model.