Abstract: An online system performs a recursive process for analyzing data using an LLM. The online system receives an initial analysis prompt from a user's client device. The online system repeatedly retrieves data from a database of the online system that can be useful for answering the prompt provided by user's analysis prompt. In one of these iterations, the online system generates a recursive prompt for an LLM of a model serving system and generates database queries that correspond to these generated text prompts. The online system can thereby apply these dynamically-generated database queries to its database to retrieve data to answer the generated text prompts. The online system repeatedly performs this process until an end condition is met. The online system generates a final prompt based on the retrieved data, the generated prompts, and the initial analysis prompt, and receives the prompted analysis from the model serving system.